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choice  functions.  A system,  celled  STEPPS,  has  been  bum  m wn.cn  e nw.  «n 
described  end  evaluation  tools  can  be  used  to  manipulate  and  act  upon  a model  to 
predict  performance  of  a program  decomposition. 

The  design  approach  is  to  describe  a multiprocessing  program  in  terms  of  the  modeling 
system.  The  model  is  examined  to  determine  some  analytic  attributes  of  the  model. 
The  analysis  available  determines  (a)  whether  the  model  is  well  formed,  (b)  whether 
Ih.  model  conteins  deadlock,,  (c)  prediction,  ol  «te,dy  elate  properties  ot  each 
process.  In  addition,  without  much  difficulty,  inalysis  functions  external  to  STEPPS 
msy  be  included  as  needed  by  a program  designer. 

Some  analyses,  that  may  be  interesting,  may  be  difficult  to  determine  without  resorting 
to  simulation.  Therefore  the  STEPPS  system  includes  a model  simulator  with  data 
collection  facilities.  The  STEPPS  data  collection  facilities  include  such  measures  as  wait 
times  and  queue  lengths.  As  in  the  case  of  analysis  functions,  STEPPS  allows  the 
inclusion  of  data  collection  facilities  not  originally  provided  by  STEPPS. 

As  a system  is  designed,  alternate  models  can  be  examined!  and  based  on  an  individual 
designer's* choice  of  performance  attributes,  a model  can  be  chosen  on  which  o base 
the  construction  of  a multiprocessor  program.  As  more  is  learned  about  .e  real 
system  parameters,  the  model  can  be  tuned  to  more  closely  predict  ultimate  system 

performance. 

Several  examples  of  communicating  processes  are  modeled  using  STEPPS  including 
pipeline  processes,  probabilistic  processes,  P/V  synchronization  and  reader /writer 
synchronization.  Two  experiments  are  presented  as  validation  of  the  usefulness  of  the 
STEPPS  tools.  In  the  Bliss/11  experiment,  the  implications  of  restricting  the  numbers 
of  available  processors  and  using  different  scheduling  algorithms  were  examined,  and 
the  effect  of  using  alternate  program  structures  was  explored.  In  the  Hearsay  II 
experiment  it  was  shown  that,  when  a multiprocess  program  under  development  is 
sufficiently  instrumented,  the  STEPPS  mrdel  and  system  can  be  used  to  help  tune  the 
program's  structure. 

The  use  of  the  tools  for  predicting  the  performance  of  a multiprocessing  program  falls 
between  purely  analytic  models,  sush  ss  queueing  theory  or  Petri-nets  and  s/s,em 
simulations  built  in  a general  purpose  simulation  language.  The  STEPPS  system  is 
presented  as  a new  approach  to  designing  multiprocessing  programs. 
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Abstract  I* 


An  approach  to  designing  programs  for  implementation  In  a multiple  instruction  stream- 
multiple  data  stream  processing  environment  is  presented.  A program  is  modeled  as  a 
directed  gr  iph  consisting  of  two  types  of  nodes:  processing  nodes  and  linking  nodes. 
Communication  among  nodes  in  the  mode!  is  represented  by  message  tokens.  Each 
processing  node  is  similar  in  form  to  a semi-Markov  process.  A simulation  of  the 
operation  of  the  model  is  nondeterministic,  but  is  based  on  prescribed  probabilistic 
choice  functions.  A system,  called  STEPPS,  has  been  built  in  which  a model  can  be 
described  and  evaluation  tools  can  be  used  to  manipulate  and  act  upon  a model  to 
predict  performance  of  a program  decomposition. 

. The  design  approach  is  to  describe  a multiprocessing  program  in  terms  of  the  modeling 
system.  The  model  is  examined  to  determine  some  analytic  attributes  of  the  model. 
The  analysis  available  determines  (a)  whether  the  model  is  well  formed,  (b)  whether 
the  model  contains  deadlocks,  (c)  predictions  of  steady  state  properties  of  each 
process.  In  addition,  without  much  difficulty,  analysis  functions  external  to  STEPHi, 
may  be  included  as  needed  by  a program  designer. 

Some  analyses,  that  may  be  interesting,  may  be  difficult  to  determine  without  resorting 
to  simulation.  Therefore  the  STEPPS  system,  includes  a model  simulator  with  data 
collection  facilities.  The  STEPPS  data  collection  facilities  include  such  measures  as  wait 
times  and  queue  lengths.  As  in  the  case  of  analysis  functions,  STEPPS  allows  the 
Inclusion  of  data  collection  facilities  not  originally  provided  by  STEPPS. 

As  a system  is  designed,  alternate  models  can  be  examined;  and  based  on  an  individual 
designer’s  choice  of  performance  attributes,  a model  can  be  chosen  on  which  to  base 
the  construction  of  a multiprocessor  program.  As  more  is  learned  about  the  real 
system  parameters,  the  model  can  be  tuned  to  more  closely  predict  ultimate  system 
performance. 

Several  examples  of  communicating  processes  are  modeled  using  STEPPS  including 
pipeline  processes,  probabilistic  processes,  P/V  synchronization,  and  reader/writer 
synchronization.  Two  experiments  are  presented  as  validation  of  the  usefulness  of  the 
STEPPS  tools.  In  the  Bliss/11  experiment,  the  implications  of  restricting  the  numbers 
of  available  processors  and  using  different  scheduling  algorithms  were  examined,  and 
the  effect  of  using  alternate  program  structures  was  explored.  In  the  Hearsay  II 
experiment  it  was  shown  that,  when  a multiprocess  program  under  development  Is 
sufficiently  Instrumented,  the  STEPPS  model  and  system  can  be  used  to  help  tune  the 
program’s  structure. 

The  use  of  the  tools  for  predicting  the  performance  of  a multiprocessing  program  falls 
between  purely  analytic  models,  such  as  queueing  theory  or  Petri-nets,  and  system 
simulations  built  in  a general  purpose  simulation  language.  The  STEPPS  system  is 
presented  as  a new  approach  to  designing  multiprocessing  programs. 
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Chapter  1 

Problem  Statement,  History  and  Goals 


I. A.  Introduction 

This  research  develops  both  a methodology  for  enhancing  the  design  of 
programs  to  be  composed  of  concurrently  executable  subparts  and  a set  of  tools  to 
support  that  methodology.  The  execution  environment  which  we  shall  be  concerned 
with  consists  of  several  processing  units  operating  under  the  control  of  separate 
instruction  streams.  Intuitively,  when  parts  of  a program  are  processed  in  such  an 
environment,  the  real  time*  required  to  execute  the  program  should  decrease^.  For 
this  reason,  as  uell  as  others,  much  current  research  effort  addresses  program 
structure  for  jus.  such  a multiprocessing  environment.  This  thesis  addresses  the 
problem  of  decomposing  programs  for  concurrent  execution  in  such  a way  that  the 
decompositions  are  efficient  with  respect  to  certain  specifiable  criteria.  The  approach 
is  to  provide  a set  of  tools  with  which  a system  designer  can  manipulate  and  analyze  a 
program  model  created  to  predict  the  performance  of  a system  designed  for  a multiple 
asynchronous  instruction  stream  environment.  The  tools  are  applicable  to  both  the 
early  design  of  a program  and  later  tuning  of  a program  under  construction. 

*"Real  time"  is  the  time  elapsed  between  tho  start  of  computation  and  the  time  the 
final  result  is  available.  It  is  different  from  the  total  processing  time  since  operations 
may  be  performed  concurrently. 

^This  does  not  always  occur.  Graham  [Graham  72]  has  shown  that  adding  more 
processors  can  increase  real  time  due  to  scheduling  anomalies. 
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There  ore  several  reasons  why  many  researchers  are  considering 
multiprocessing  and  problem  restructuring  In  favor  of  merely  building  faster  computer 
hardware  without  explicit  concurrency.  First,  certain  problems  overwhelm  current  and 
projected  technology  when  programmed  for  single  Instruction  stream  computers.  An 
example  is  the  problem  of  weather  forecasting  for  any  single  place  on  the  earth.  At 
present,  this  problem  can  not  b^  solved  with  enough  lead  time  to  make  the  forecast 
useful.  Another  large  problem  is  fast-response  scheduling,  cost  accounting,  and 
resource  management  for  large  corporations.  In  this  problem  the  mathematical 
computations  are  not  necessarily  as  complex  as  those  for  weather  forecasting,  but  the 
amount  of  data  processing  required  can  be  extremely  large  and,  as  for  weather 
prediction,  there  is  a time  constraint  on  the  answers.  For  each  of  these  problems,  a 
solution  might  be  attainable  In  a reasonable  period  of  time  If  some  of  the  computations 
could  be  distributed  and  executed  In  parallel.  Among  the  unknown  factors  are  how  tho 
problems  should  be  decomposed  for  distributed  processing  and  what  communication 
constraints  and  processing  attributes  elicit  favorable  computational  attributes  (such  as 
real  time  speed  and  low  cost). 

There  may  also  be  economic  incentives  to  implement  a program  In  a 
multiprocessing  environment.  For  example,  it  may  be  less  expensive  to  Implement  a 
speech  understanding  system  on  a set  of  minicomputers  than  on  one  fast  and  relatively 
complex  uniprocessing  computer.  The  price  benefits  may  occur  because  of 

1.  the  use  of  so  called  off-the-shelf  equipment  making  total  processing 
power  cheaper  than  large  uniprocessing  machines,  and 

2.  economies  of  scale  in  manufacturing. 

Perhaps  the  most  compelling  reason  (possibly  a consequence  of  the  first  two) 
for  wanting  to  decompose  programs  for  multiprocessing  environments  is  that  such 


l.A  Introduction 


1-3 


environments  are  now  available  and  It  is  important  to  use  the  n properly.  C.mmp  [Wulf 
72b],  BBN  Pluribus  IMP  [Heart  73],  tho  Burroughs  D825  [Anderson  62],  UC  Berkeley’s 
Prime  [Quatse  72],  and  UC  Irvine’s  DCS  [Farber  75]  all  have  some  multiprocessing 
capabilities.  Additionally  Clark’s  macrormdules  [Clark  72],  Bell’s  register  transfer 
modules  (DEC  POP- 16)  [Bell  72]  and  the  similarly  oriented  projects  of  Fuller  and 
Slewlorek  [Fuller  73],  and  others  offer  multiprocessing  on  a very  low  level. 

There  are,  at  present,  no  guidelines  for  decomposing  a problem  for 
multiprocessing  execution  [Newell  75].  A number  of  questions  related  to  the  discovery 
of  such  guidelines  have  been  investigated.  These  include. 

1.  Can  a problem  be  decomposed  for  solution  in  a multiprocessing 
environment?  [Karp  66,  Gosden  66,  Miranker  71,  Dennis  71,  Anderson  65, 
Rosonfeld  69] 

2.  How  can  the  algorithmic  structure  of  a multiprocessing  task  be 
represented?  [Adams  70,  Baer  70,  Bredt  70,  Dennis  71,  Dennis  73a,  73b, 
Karp  69,  Lesser  72,  Miller  73,  Noe  73] 

3.  Will  the  same  results  always  occur,  namely  will  a multiprocessing  system 
be  deterministic?  Can  a multiprocessing  system  be  proven  correct?  Are 
there  potential  deadlocks  and  unattainable  states?  This  Is  somewhat 
analogous  to  discovering  infinite  loops  and  impossible  conditions  In  a 
sequential  program.  [Karp  69,  Keller  73a,  73b,  Riddle  72] 

4.  When  are  two  computations  the  same?  [Karp  69,  Keller  73a,  73b] 

5.  What  measures  are  interesting  about  the  computation?  Some  may  be: 
speed,  redundancy,  (inefficiency,  resource  utilization,  and  economies  of 
the  components.  [Browne  73,  Lehman  66] 

6.  How  can  the  system  be  scheduled  when  there  are  scarce  resources? 
[Adam  72,  Graham  72] 

7.  How  can  bottlenecks  be  identified  and  their  effects  lessened  or  eliminated? 
[Courtois  72,  Dijkstra  74,  Rice  73] 

8.  What  are  the  effects  of  restructuring  the  communications  among  the 
cooperating  processes?  [Balzer  71,  Horning  73] 

9.  What  style  of  decomposition  and  machine  structure  would  i st  suit  t. 
particular  programming  system  (eg.  Illiac  IV,  STARAN,  STAR-100,  ASC, 
C.mmp,  etc.)?  [Flynn  66] 
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environments  are  now  available  and  it  i6  important  to  use  them  properly.  C.mmp  [Wulf 
72b],  BBN  Plurlbus  IMP  [Heart  73],  the  Burroughs  D825  [Anderson  62],  UC  Berkeley’s 
Prime  [Quatse  72],  and  UC  Irvine’6  DCS  [Farber  75]  all  have  some  multiprocessing 
capabilities.  Additionally  Clark’s  macromodules  [Clark  72],  Bell’s  register  transfer 
modules  (DEC  PDP-16)  [Bell  72]  and  the  similarly  oriented  projects  of  Fuller  and 
Slewiorek  [Fuller  73],  and  others  offer  multiprocessing  on  a very  low  level. 

There  are,  at  present,  no  guidelines  for  decomposing  a problem  for 
multiprocessing  execution  [Newell  75].  A number  of  questions  related  to  the  discovery 
of  such  guidelines  have  been  investigated.  These  include: 

1.  Can  a problem  be  decomposed  for  solution  in  a multiprocessing 
environment?  [Karp  66,  Gosden  66,  Miranker  71,  Dennis  71,  Anderson  65, 
Rosenfeid  69] 

2.  How  can  the  algorithmic  structure  of  a multiprocessing  task  be 
represented?  [Adams  70,  Baer  70,  Bredt  70,  Dennis  71,  Dennis  73a,  73b, 
Karp  69,  Lesser  72,  Miller  73,  Noe  73] 

3.  Will  ihe  same  results  always  occur,  namely  will  a multiprocessing  system 
be  deterministic?  Can  a multiprocessing  system  be  proven  correct?  Are 
there  potential  deadlocks  and  unattainable  states?  This  Is  somewhat 
analogous  to  discovering  infinite  loops  and  impossible  conditions  In  a 
sequential  program.  [Karp  69,  Keller  73a,  73b,  Riddle  72] 

A.  When  are  two  computations  the  same?  [Karp  69,  Keller  73a,  73b] 

5.  What  measures  are  interesting  about  the  computation?  Somu  may  be: 
speed,  redundancy,  (inefficiency,  resource  utilization,  and  economies  of 
the  components.  [Browne  73,  Lehman  66] 

6.  How  can  the  system  be  scheduled  when  there  are  scarce  resources? 
[Adam  72,  Graham  72] 

7.  How  can  bottlenecks  be  identified  and  their  effects  lessened  or  eliminated? 
[Courtois  72,  Dijkstra  74,  Rice  73] 

8.  What  are  the  ef'ects  of  restructuring  the  communications  among  the 
cooperating  processes?  [Baizer  71,  Horning  73] 

9.  What  style  of  decomposition  and  machine  structure  would  best  suit  a 
particular  programming  system  (eg.  Illiac  IV,  STARAN,  STAR-100,  ASC, 
C.mmp,  etc.)?  [Flynn  66] 
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The  last  question  points  out  that  there  are  several  styles  of  multiprocessing. 
Flynn  [Flynn  66]  described  processing  organization  in  four  ways: 
single  instruction  stream  - single  data  stream(SlSD), 
single  instruction  stream  - multiple  data  streams  (SIMD), 
multiple  instruction  streams  - single  data  stream  (M1SD),  and 
multiple  instruction  streams  - multiple  data  streams  (M1MD). 

These  computing  styles  may  he  used  to  describe  an  entire  computing 
environment  and  affect  a problem’s  decomposition  and  algorithms.  However  those 
systems  that  do  not  allow  a programmer  to  program  explicitly  for  multiple  streams  of 
data  or  instructions  will  be  considered  as  single  stream  machines.  For  example,  any 
multiprogramming  machine  performs  some  operations  concurrently  (e.g.  I/O),  but  a 
programmer  is  usually  unable  to  control  this  concurrency.  In  an  array  or  associative 
processor  a control  unit  specifies  which  operation  is  performed  simultaneously  on 
many  data  items  simultaneously  --  these  are  SIMD  machines.  The  current  pipeline 
machines  (CDC  STAR-100,  TI  ASC)  perform  parts  of  single  operations  on  several  pieces 
of  data.  The  programmer  has  no  control  over  which  operations  are  performed 
concurrently,  so  these  are  also  single  instruction  stream  machines*.  Even  in  multiple 
instruction  stream  processing  there  can  still  be  a spectrum  of  communication  schemes. 
Networks  of  computers  and  multiprocessing  computers  with  common  memory  are  are 
defined  to  be  multiple  instruction  stream  machines  only  when  a programmer  can 
specify  concurrent  operations  and  these  operations  can  be  performed  concurrently. 

A multiple  Instruction  stream  program  Is  defined  to  be  a program  In  which  two 
subparts  of  the  program  can  be  specified  to  execute  concurrently.  Since  these  are 

* A pipeline  machine  has  multiple  data  streams  as  far  as  a programmer  Is  concerned, 
but  actually  the  stream  of  data  comes  into  the  pipe  sequentially. 
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subparts  of  a total  there  is  some  relationship  between  them.  The  relationship  must  be 
in  the  form  of  some  common  data  communication  and/or  sharing  If  the  subparts  are 
named  A and  B then  at  least  one  of  the  following  must  occur:  data  progress  from  A to 
0,  from  B to  A,  from  some  C to  A and  B,  or  from  A and  B to  some  C.  (Figure  1-1  shows 
the  possible  relationships  between  two  processes  in  a directed  graph  notation)  When 
data  progress  from  one  program  to  another  It  means  that  the  second  program  usee 
some  results  of  the  first  In  its  computations.  Of  course,  other  processing  may 
manipulate  the  data  between  the  processing  of  two  subprograms  and  additional  data 
may  be  provided  to  the  second  program  from  sources  other  than  the  first  program 


Figure  1-1.  Possible  relationships  between  two  processes,  A and  B 

If  A and  B are  related,  one  of  these  relationships  must  hold;  otherwise  A and  B 
' would  be  unrelated  and  thus  not  subparts  of  the  same  program.  In  the  first  and 
second  cases  one  subprogram  sends  data  to  the  other  and  continues  to  process  after 
sending  data  to  the  second  subprogram.  In  the  third  case,  data  can  progress  to  both  A 
and  B from  a common  source  and  aii  three  can  be  processed  at  the  same  time.  In  the 
last  case,  A and  B can  be  processed  simultaneously  and  each  Is  able  to  send  data  to 


the  same  third  process,  C. 
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f.B.  Direction  of  this  work 

At  present  there  are  no  proven  guidelines  on  how  to  structure  a problem  for 
implementation  in  a multiple-instruction-stream  multiprocessing  environment  Rather 
than  address  the  guidelines  problem  directly,  this  work  presents  a design  environment, 
a set  of  evaluation  tools,  and  a design  approach  whereby  a system  designer  can 
explore  attributes  of  alternative  program  decompositions.  A major  premise  for  this 
research  is  that  the  communication  pattern  among  concurrent  processes  is  critical  to  a 
system’s  performance.  The  goal  is  to  identify  issues  end  \o  make  predictions  which 
will  provide  some  practical  information  to  the  system  designer  at  an  early  stage  and 
also  during  later  program  tuning.  This  research  has  been  directed  towards  solving  a 
more  specific  set  of  problems  than  those  presented  in  the  previous  list,  namely: 

1.  How  can  interactions  among  the  concurrent  computations  be  modeled? 

2.  Are  the  interactions  safe,  i.e.  deadlock  free?  For  example,  can  one  show 
that  a program  never  arrives  at  a state  in  which  one  process  is  trying  to 
communicate  with  a second  process  while  the  second  is  waiting  to  send  a 
communication  to  the  first  process? 

3.  When  the  structure  is  not  deadlock  free,  whet  is  the  probability  of  a 
deadlock? 

4.  Where  will  mo?;t  of  the  process  and  communication  activity  occur? 

5.  Where  ttlenecks  occur,  and  how  may  they  be  relieved?  For 

examp  introduction  of  buffers  or  additional  processes  help? 

6 Are  there  working  sets  of  processes?  If  certain  subsets  of  processes 
tend  to  be  active  at  different  times  then  fewer  processors  will  be 
required  for  a program  (and  consequently  less  parallelism  can  be 

attained). 

7.  What  are  the  effects  of  restricting  the  number  of  processors?  What  are 
the  effects  of  alternative  scheduling  algorithms? 

These  questions  were  chosen  because  they  may  present  hidden  problems  to 
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the  system  designer.  Inexpensive  and  fast  approximate  answers  to  these  questions 
should  be  useful  when  a program  is  being  designed  and  also  when  It  Is  being  tuned  to 
Improve  a program’s  performance. 

Currently  there  are  no  generally  accepted  languages  or  graphical  techniques 
for  representing  or  modeling  a multiprocessing  computation  and  the  commumcat.on 
interactions  among  processes.  Thus  problems  that  might  be  prevented  by  a clear 
algorithmic  description  technique  may  still  occur.  However  a system  designer  has  some 
understanding  of  the  relationships  among  the  parts  of  his  system.  He  can  implement 
the  subparts  in  many  different  languages,  but  it  is  the  interfaces  between  the  subparts 
that  are  usually  not  we'l  described.  Parnas  [Parnas  71]  has  suggested  communication 
schema  to  be  used  while  creating  communicating  modules,  but  has  not  described  how 
to  represent  the  communications  in  an  entire  system.  This  lack  of  global  view  may 
prevent  the  recognition  of  potential  problems.  This,  then,  illustrates  the  importance  of 
discovering  a method  for  the  automatic  detection  of  deadlocked  structures  and 
potential  deadlocked  structures.  If  the  system  designer  can  easily  identify  in  advance 
where  he  may  have  made  such  an  error,  then  he  is  spared  the  task  of  finding  the 
problem  later.  It  would  be  preferable  to  prevent  such  problems,  since  many  of  the 
criteria  for  preventing  deadlocks  are  known;  however,  in  complex  systems  it  is 
increasingly  difficult  to  be  aware  of  all  potential  deadlock  conditions. 

If  the  system  designer  is  able  to  estimate  which  particular  subparts  of  his 
system  will  contain  the  largest  amount  of  activity,  then  these  suhparts  will  be  the  most 
appropriate  places  to  expend  effort  to  Improve  performance. 

The  ability  to  compare  the  potential  performance  of  alternate  systems  easily  is 
extremely  important.  Almost  all  disciplines  concerned  with  the  creation  of  large 
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interacting  subsystems  use  the  technique  of  moiling  the  behsvior  of  the  whole 
system  and  extrapolating  the  performance  of  this  model  to  deduce  properties  of  the 
large  system.  Examples  of  this  technique  range  from  the  use  of  wind  tunnels  and 
analog  simulation  of  fluid  flow  to  discrete  computer  simulations  of  supermarket  check- 
out counters.  A tool  for  the  prediction  of  computer  system  decomposition  performance 
should  be  just  as  useful.  An  important  aspect  of  a design  system  is  how  easily  the 
designer  can  alter  the  attributes  of  his  system  and  determine  the  effects  of  those 

changes. 

We  feel  that  important  assets  of  design  tools  are  that  they: 

1.  be  easy  to  use, 

2.  provide  results  quickly, 

3.  be  interactive  (when  using  a computer  system),  and 

4.  make  it  easy  to  perform  design  Iterations. 

I.C.  Other  work  bearing  on  the  problem 

Several  kinds  of  tools  are  available  to  a system  designer.  These  tools  include 
graph  models,  queueing  theory  models,  simulation  languages,  programming  languages 
and  theories  of  design  of  complex  systems.  Each  of  these  tools  can  be  useful  at  some 
time  during  the  design  and  construction  of  a multiprocessing  program.  Graph  models 
are  usually  used  to  represent  multiprocessing  computations  and  for  analysis  of  control 
/low  within  a program.  Queueing  theory  is  used  to  predict  and  study  performance  of 
simplified  models  of  complex  processes.  Simulation  is  an  approach  to  modeling  more 
complex  systems  to  obtain  similar  performance  predictions.  Programming  languages 
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are  tools  for  explicitly  representing  multiprocess  algorithms.  They  also  may  contain 
primitive  operators  that  can  facilitate  proofs  of  properties  of  programs.  Design 
theories,  such  as  that  of  Parnas,  provide  techniques  that  facilitate  construction  of 
complex  systems  and  their  understanding.  No  one  tool  is  comprehensive  enough  to  use 
as  a quickly  obtained  predictor  of  the  performance  of  a multiprocess  program. 

With  sufficient  instrumentation  the  behavior  of  a multiprocess  program  can  be 
measured.  These  data  can  be  used  in  several  ways  to  predict  behavior  changes  when 
some  system  parameters  and  structures  are  modified.  Again  queueing  theory  and 
simulation  techniques  are  useful  tools  for  these  predictions.  As  before  neither  method 
necessarily  provides  fast  predictions  of  the  sensitivity  of  performance  to  changes  in 
program  parameter  and  structure. 

The  following  are  brief  presentations  of  some  tools  that  bear  a relationship  to 
those  that  will  be  presented  later.  It  will  be  seen  that  the  purely  analytic  techniques 
are  often  too  restrictive  on  assumptions,  not  useful  for  overall  program  design,  and  of 
limited  applicability  due  to  computational  complexity.  The  simulation  techniques  require 
too  much  effort  both  to  construct  a simulation  and  to  modify  It  to  achieve  results 
concerning  alternate  program  decompositions. 

I.C.l.  Petri  neta 

After  the  original  formulation  of  Petri  nets  [Petri  62]  several  MIT  researchers 
[Dennis  70,  Holt  70,  Paterson  70,  Rodriguez  67]  refined  forms  of  the  original  model  as 
useful  tools  for  studying  concurrent  processes.  A Petri  net  looks  like  a directed  graph 
in  which  marks  or  tokens  are  placed  on  some  of  the  arcs.  (Only  connected  graphs  are 
of  interest.)  These  tokens  move  about  the  graph  to  represent  flow  of  control.  When 


tokens  are  present  on  all  of  the  Input  arcs  to  a node,  that  node  Is  able  to  "fire."  After 
a node  fires,  one  token  is  removed  from  each  input  and  a token  Is  placed  on  each 
output  arc  of  that  node.  In  fact,  a Petri  net  Is  not  a directed  graph  [Berge  62] 
because  it  Is  possible  for  one  ire  to  por  t to  or  come  from  more  than  one  node.  A 
restricted  Petri  net  called  a marked  graph  [Holt  70]  permits  arc  Initiation  and 
termination  only  at  single  nodes  (not  necessarily  the  same).  Multiple  arcs  can  still  be 
connected  to  each  node.  In  contrast,  a restricted  Petri  net  becomas  a finite  state 
automaton  (state  transition  diagram  [Holt  70])  by  only  permiting  one  arc  to  enter  each 
node  and  one  arc  to  leava  each  node.  (Arcs  can  have  multiple  starting  points  and 
terminal  points.)  In  Figures  1-2,  1-3,  and  1-4  the  nodes  are  represented  by  straight 
lines  and  the  arcs  are  arrows  with  a circle  that  can  contain  the  tokens  (represented  by 
dots). 
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Figure  1-2.  A Marked  graph 


Figure  1-3.  A finite  state  atomaton. 


I.C  Other  work  bearing  on  the  problem 


1-11 


Figure  1-4.  A Petri  net  that  is  neither  a marked  graph  nor  a finite  state 
atomaton. 

Marked  graphs  are  the  oniy  form  of  Petri  nets  that  have  been  used  to  study 
concurrent  processes.  The  general  Petri  net  can  be  too  complex  and  the  state 
transition  diagram  can  not  be  used  to  model  concurrent  processing.  Marked  graphs 
are  used  by  modeling  the  potential  flow  of  control  in  a system  and  then  analyzing 
possible  markings  in  order  to  make  predictions  about  future  markings.  Issues 
investigated,  for  a particular  initai  marking,  include: 

1.  Determine  whether  nodes  will  eventually  activate  (fire).  In  Petri  net 
terminology  the  question  is  whether  a node  is  "safe"  [Holt  70].  If  ail 
nodes  are  safe  the  net  is  "safe,"  i.e.  all  nodes  can  be  activated. 

2.  Count  the  number  of  activations  of  a node.  The  important  counts  are  0,  n, 
and  infinity. 

3.  Determine  whether  the  initial  marking  can  lead  to  another  particular 
marking. 

4.  Identify  nodes  that  can  fire  concurrently. 

There  are  several  difficulties  in  using  Petri  nets.  One  is  that  interesting 
examples  require  a large  number  of  nodes  [Dennis  70,  Merlin  75].  There  are  so  many 
nodes  that  it  is  difficult  to  do  any  analysis.  In  addition,  none  of  the  analysis  is 
mechanical.  Another  difficulty  is  thfct  control  flow  in  the  graphs  is  completely 
determined  with  no  accounting  for  rates  of  processing  at  each  node. 


\C,2.  The  UCLA  model 


The  original  goal  of  the  UCLA  mode!  was  to  "represent  programs  to  be  run  on 
variable  structure  computers"  [Baer  73,  Estrin  63].  Thus  its  purpose  was  to  help 
describe  concurrent  compulsions  rather  than  to  study  the  performance  of  algorithms. 
However  some  extensions  of,  and  associated  restrictions  on,  the  original  model  allow 
for  performance  predictions  in  some  restricted  cases  to  determine  the  termination  of 
loops,  the  determinacy  of  representations  [Regis  72],  and  the  reduction  of  graphical 
forms  [Bovet  69].  In  addition  the  UCLA  model  has  been  used  to  study  the  automatic 
conversion  of  r'ORTRAN-like  programs  to  a parallel  computation  form. 

The  basic  form  of  the  model  is  a directed  binary  graph.  Most  studies  using  this 
model  use  an  acyclic  structure.  The  graph  shows  processing  dependencies  and,  as 
long  as  an  acyclic  model  is  used,  potentially  concurrent  operations  can  b'v  easily 
identified.  Each  node  may  have  at  most  two  entry  arcs  and  also  at  most  two  exit  a.  „«\ 
The  rules  for  firing  a node  are  defined  ss  part  of  the  node.  The  node’s  firing  rule 
depends  on  the  enabling  of  the  input  8rcs  and  the  node’s  resuit  rule  cause  some  of  its 
output  arcs  to  be  enabled.  A node  will  not  fire  if  any  of  its  output  arcs  are  already 
enabled.  Once  a node  fires  the  input  arcs  causing  that  node  to  fire  are  disabled.  (See 
Figure  1-5) 

In  the  UCLA  model,  branching  and  merging  control  flow  are  modeled  with  EOR 
type  nodes.  Concurrency  is  modeled  by  the  use  of  AND  type  nodes. 

Further  restrictions  are  placed  on  the  form  of  the  UCLA  graph  model.  There 
must  be  a unique  initial  vertex  (only  output  arcs)  and  a unique  terminal  vertex  (only 
input  arcs).  Another  restriction  is  that  all  subgraphs  must  be  AND  type.  This  means 
that  if  a choice  is  made  at  an  EOR  output  node  then  it  must  stiii  be  possible  for  the 


AND  input  type  fires  only  If  both  input  arcs  have  been  enabled. 


EOR  Input  node 

EOR  input  type  fires  only  if  exacliy  one  of  the  input  arcs  has  been  enabled 

AND  output  node 

AND  output  type  enables  both  of  the  node’s  output  arcs  after  the  node  has  fired. 

EOR  output  node 

EOR  output  type  enables  exactly  one  of  the  node’s  output  arcs  after  a node  has  fired 
(which  one  is  undetermined). 

Figure  1-5.  UCLA  Model  Nodes. 

terminal  node  to  fire,  In  addition  It  should  not  be  possible  for  both  arcs  of  an  EOR 
Input  node  to  be  enabled  at  once.  The  question  of  determlnacy  of  a graph  is 
subsumed  by  the  question  of  legal  graphs.  Legal  graphs  are  those  that  start  at  the 
Initial  node  and  are  guaranteed  to  terminate  at  the  terminal  node.  When  loops  are 
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allowed,  any  loop  must  be  able  to  terminate.  Most  who  have  used  the  model  have 
assumed  acyclic  structures  in  order  to  guarantee  loop  termination  (naturally,  no  loops). 
The  analytic  technique  used  to  ignore  loops  is  to  expand  all  loops  by  some  finite 
repetition.  The  repetition  factor  is  determined  by  a probabilistic  argument  [Martin  67]. 

The  question  of  mean  path  length  in  a directed  acyclic  binary  graph  has  been 
studied  at  UCLA.  Probabilities  are  assigned  to  each  arc  and  computation  times  are 
assigned  to  each  node.  These  are  used  to  determine  the  probability  of  traversing 
paths  through  a legal  graph  and  to  estimate  the  mean  path  time  of  a graph  [Martin  69]. 
One  may  also  determine  the  maximum  number  of  processors  required  by  the  graph 
[Baer  69]  under  the  same  restrictions. 

The  difficulties  with  using  the  UCLA  model  also  involve  the  need  for  a large 
number  of  nodes  to  represent  interesting  structures.  This  is  particularly  true  since 
each  node  has  at  most  two  input  arcs  end  at  most  two  output  arcs.  Another  problem  is 
that  most  results  have  been  dependent  on  acyclic  models.  Thus  the  mechanical 
techniques  for  proving  legal  graphs,  etc.  are  only  applicable  to  a restricted  set  of 
programs  representable  by  the  model. 

I.C.3.  An  algebraic  model  of  interprocess  communication 

In  his  dissertation  [Riddle  72],  Riddle  presented  a methodology  for  modeling 
and  analyzing  supervisory  systems,  but  the  work  can  be  applied  to  the  problem  of 
analyzing  any  complex  asynchronous  system.  He  found  the  same  difficulties  with  Petri 
nets  and  other  models  as  those  reported  in  earlier  sections  of  this  chapter. 

Riddle  presented  an  explicit  program-like  description  of  the  operation  of  a 
process.  This  description  was  only  concerned  with  the  interprocess  communication 
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relationships  of  each  process.  However  the  description  was  close  enough  to  being  a 
program  that  each  process  required  information  concerning  the  type  of  interprocess 
messages.  Therefore  the  descriptions  of  processes  were  themselves  fairly  complex. 

The  model  was  also  based  cn  a directed  graph  structure  representing 
interprocess  communication.  A graph  consisted  of  two  types  of  nodes,  process  nodes 
and  link  nodes.  The  link  nodes  had  properties  that  could  require  a certain  amount  of 
computation  associated  with  them,  e.g.  queueing  disciplines. 

One  of  the  goals  of  Riddle’s  research  was  the  development  of  an  algebra  to 
describe  interprocess  communication.  Algebraic  expressions  could  be  used  to  describe 
possible  communication  paths  in  a model.  By  using  the  graphical  structure,  the 
program-like  descriptions,  and  the  algebraic  expressions,  theorems  were  developed  to 
analyze  the  behavior  of  a modeled  systim.  The  creation  of  all  algebraic  expressions  is 
performed  by  the  inspection  of  a graph.  The  proof  of  theorems  concerning  the 
behavior  of  a system,  as  described  by  the  algebra,  is  not  a mechanical  process.  Riddle 
did  provide  a set  of  theorems  that  can  be  used  in  a proof. 

The  examples  that  Riddle  studied  were  based  on  communication  paths  of  a 
given  system.  He  determined  what  termination  and  deadlock  meant  for  that  system  and 
was  able  to  derive  proofs  showing  that  the  system  terminated  and  contained  no 
deadlocks.  The  questions  he  posed  were  specific  to  the  system  being  modeled  and 
required  the  creation  of  algebraic  expressions  *or  each  question  concerning  system 
behavior.  These  algebraic  expressions  were  not  necessarily  easy  to  create  and  the 
proofs  of  theorems  were  not  very  easy  to  construct. 

The  tools  that  Riddle’s  research  provides  may  be  used  for  the  design  of 
multiprocessing  programs.  The  drawbacks  to  his  approach  are  the  difficulty  and  effort 
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required  to  create  the  algebraic  expressions  needed  to  represent  a model,  and  the 
expressions  representing  communication  within  a model.  The  expression  proof  process 
is  also  fairly  tedious. 

I.D.  The  STEPPS  System 

All  of  the  models  discussed  in  the  previous  section  are  tools  for  the  analysis  of 
multiprocess  programs.  A common  drawback  of  each  model  is  that  results  must  be 
obtained  through  detailed,  non-mechanical  analysis.  A second  drawback  is  that  none 
contains  the  processing  rates  of  the  various  processes  of  a multiprocess  program  as 
part  of  the  model.  The  speed  and  ease  of  obtaining  results  and  the  ability  to  include 
expected  timing  of  attributes  of  a program  can  be  especially  useful  when  making  early 
design  decisions  concerning  the  structure  of  a program. 

The  design  methodology  presented  in  this  thesis  is  based  on  an  inU-ractive 
system  utilizing  a particular  model  of  multiple  instruction  stream  problem 
decomposition.  The  system  and  the  model  are  called  STEPPS  (Some  Tools  for 
Evaluating  Parallel  Processing  Systems).  The  methodology  of  designing  a programming 
system  has  become  an  interesting  and  important  question  in  the  last  few  years  [Brinch 
Hansen  74,  Dahl  72,  Mills  71,  Parnas  72,  Parnas  75,  Weinberg  71].  The  author 
subscribes  to  the  "top  down"  approach  to  system  design  [S’mon  62}  Thus  a "natural" 
approach  to  building  a system  that  will  contain  potentially  concurrently  executing 
subparts  is  to  decompose  a system  into  functionally  independent  subparts  and 
describe  the  communication  structure  among  the  subparts  before  explicitly  defining  the 
operation  of  the  subparts.  For  example,  when  designing  a compiler  one  might  say  that 
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the  LEXICAL-ANALYSER  and  the  SYNTAX -ANALYSER  could  process  in  a pipeline  manner 
with  the  LEXICAL-ANALYSER  sending  results  to  the  SYNTAX -ANALYSER.  A convenient 
notation  is  a directed  graph  notation  with  the  restriction  that  the  connections  between 
two  processes  must  go  through  an  explicitly  designated  (and  named)  connecting  LINK 
(see  Figure  1-6).  At  this  stage  of  decomposition  only  potential  communication  is 
important  and  data  dependent  communication  (i.e.  decisions  based  upon  data)  is  not 
considered  at  all. 


LI 


Figure  1-6.  Pipeline. 

Each  of  the  previously  discussed  models  considers  interprocess  communication 
patterns  to  be  impcrtant  for  understanding  the  performance  of  multiprocess  programs. 
Both  the  Petri-net  and  the  UCLm  model  represent  interprocess  communication  by 
means  of  the  movement  of  untyped  tokens.  Queueing  models  of  multiple  processes 
a’’0  use  typeless  tokens  to  represent  flow  of  control.  Riddle  was  able  to  simplify 
jome  interprocess  connections  in  his  model  schema  and  to  enhance  analysis  by 

Introducing  type  identification  for  tokens. 

The  STEPPS  model  uses  typeless  tokens  to  represent  flow  among  processes. 
The  study  of  interprocess  communication  suggests  several  measures  of  multiprocess 
performance  such  as  queue  iengths,  deadlocking,  and  potential  concurrency.  A 
difference  between  this  model  and  the  earlier  models  Is  that  a STEPPS  process  must 
be  ready  for  a message  before  "firing"  (due  to  the  arrival  of  a message)  instead  of  Its 
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firing  being  dependent  on  logical  relations  of  the  messages  available  on  paths  to  lt.^ 

I.D.l.  The  STEPPS  model:  an  informal  description 

The  STEPPS  model  includes  both  probabilistic  and  timing  expectations  for 
describing  individual  process  activity.  Whereas  a standard  probabilistic  model,  i.e, 
Poisson,  treats  processes  as  operating  on  messages,  the  STEPPS  model  process 
includes  a natural  relationship  between  a process’  input/output  activities.  In  addition, 
the  introduction  of  time  parameters  allows  for  better  estimation  of  a program’s 
operational  concurrency  instead  of  potential  concurrency.  The  model  represents 
multiprocessing  at  the  message  communication  level  and  is  not  intended  to  represent 
other  multiprocessing  problems  such  as  memory  interference  and  specific  programming 
techniques. 

Concurrency  can  be  modeled  by  having  a single  process  send  data  to  more 
than  one  other  process.  Data  streams  are  explicitly  merged  when  a process  receives 
data  from  more  than  one  other  process.  In  the  descriptions  of  processes,  more  than 
one  arrow  may  leave  a process  node  or  enter  a process  node.  If  a process  node  is 
able  to  receive  data  from  any  of  several  processes,  but  the  receiving  process  does  not 
care  which  process  sent  the  data,  several  arrows  enter  a linknode  and  only  one  leaves 
it.  If  one  of  several  processes  may  operate  on  data  produced  by  another  process  this 
is  represented  by  more  than  one  arrow  emanating  from  a linknode  snd  going  to  the 
separate  process  nodes. 


t 


In  Riddle's  model  a process  must  be  explicitly  programmed  to  accept  a message. 
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Example  I.D- 1 

Consider  the  problem  of  building  an  oniine  university  registration 
system.  This  system  would  handle  ail  of  the  scheduling  and  student 
record  keeping  for  a university.  One  might  decompose  the  problem  into 
the  graph  of  Figure  1-7.  Students'  requests  are  bandied  either  by  a 
Schedule  Requester  or  Schedule  Updater,  each  of  which  processes  the 
request  and  sends  data  to  a Scheduler.  The  Scheduler  sends  data  to 
the  Data  Base  and  then  sends  results  to  a Schedule  Output  process. 
Requests  to  the  system  may  also  come  from  the  Registrar.  These 
requests  may  also  go  to  the  Data  Base  and  on  return  data  Is  sent  to  the 
Registrar  Output  by  the  Transcript  request  process.  There  also  may  be 
requests  for  grades.  The  data  base  may  access  data  in  either  the 
Current  Semester  or  its  Archives. 


All  data  travels  through  paths  between  nodes  (the  LINKS  and  the 
PROCESSES)  in  units  called  messages  and  all  queueing  of  messages  occurs  at  each 
LINK.  Requests  for  data  from  « LINK  are  handled  in  a FIFO  (First  In,  First  Out)  manner 
by  the  LINK.  The  next  step  is  to  describe  the  action  of  a PROCESS  node.  Since  only 
the  communication  paths  are  important  at  this  point  of  design,  only  the  message 
handling  properties  of  a procass  are  described  The  source  of  data  is  not  identifiable, 
so  a proceaa  neither  knows  which  process  sent  the  data  to  the  LINK  attached  to  any  of 
ita  "input  ports"  nor  does  it  know  which  processes  are  attached  to  the  LINK  that  is 
attached  to  any  of  its  "output  ports."  The  reason  for  this  restriction  is  that  messages 
contain  no  information  such  as  sender  or  receiver  identity.  This  will  be  shown  not  to 
cause  difficulty  in  using  the  model. 

The  execution  sequence  of  a process  is: 

1.  perform  an  input  or  output  operation, 

2.  choose  which  input  or  output  port  wiil  be  active  next, 

3.  compute  for  some  time,  and 

4.  repeat  1 to  4. 
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type  of  either  T for  inpot  or  W lor  output  end  . number.  A transition  metrl*  for 
„ch  process  defines  the  probability  of  succeeding  the  estivation  of  on.  port  with  the 

activation  of  another  port.  The  informal  definition  ...»  ./  » P"*«*  to  ,he  m08' 

recent  port  activation  (in  this  thesis,  ......  correspond  to  port  activations).  The 

process  remains  In  the  same  .....  while  it  is  computing  and  enters  a new  state  et  the 

activation  of  a port.  In  most  contexts  the  terms  W art  'porf  .re  used 

interchangeably. 


Example  I.D-2 


Al  PHA  is  a orocess  with  two  input  ports,  10  and  12,  and  two  output 
poTot  and9  02  !o  may  tr.nsf.9  to  state  01  or  02.  B may  r.nst.r 
to  state  01  or  02.  01  may  only  transfer  to  state  10.  02  may 
oniy  to  state  I?.  The  graph  and  transition  matrix  for  this  process  Is 

shown  in  Fiaure  1-8. 


Graph  notation 
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Figure  1-8.  Process  ALPHA 

The  transition  matrix  makes  it  possible  to  describe  the  splitting  of  processing, 
the  merging  of  processing,  and  the  choice  of  alternate  computation  paths.  In  Example 


l.D-2,  after  an  input  from  port  10,  process 


ALPHA  can  enter  either  state  01  or  02  (with 
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probability  of  "a"  to  01  and  ■»  - to  02).  Stata  01  always  enters  state  10  as  the 
next  state. 

Other  features  of  a STEPPS  mode!  that  can  be  specified  are: 

1.  the  initial  state  of  each  process, 

2.  the  number  of  messages  that  a port  may  receive  Or  send  before  the 
process  changes  state, 

3.  the  amount  of  computation  time,  defined  for  each  transition  that  a procese 
computes  before  a transition  takes  place  (this  is  fixed,  but  random 
variable  computation  times  can  be  approximated), 

4.  the  amount  of  computation  time  taken  by  a LINK  to  accept  or  send  a 
message,  or  to  restart  when  it  is  not  already  handling  communication  of 

messages,  and 

5.  the  queue  size  limits  for  each  link  and  the  initial  number  ot  messages  in 
each  link. 

The  model  that  has  just  been  described  subsumes  both  the  Petri  net  and  the 
UCLA  model.  The  links  and  nodes  of  Petri  net  and  STEPPS  models  are  very  similar; 


each  is  equivalent  to  the  corresponding  STEPPS  model  shown  in  Figure  1-9.  Figure  I- 
10  also  shows  the  relationships  between  the  UCLA  model  and  the  STEPPS  mode/. 

The  STEPPS  model  allows  for  a more  general  specification  of  data  flow  than  the 
earlier  models  since  it  is  possible  to  describe  the  probabilities  that  particular  data 


paths  may  be  taken.  When  a message  is  accepted  by  a process  it  is  easy  to  specify 
which  data  paths  are  more  likely.  As  further  information  about  the  system  being 


designed  is  learned  or  when  the  effects  of  alternate  data  path  specification  are  taken 
into  account,  probabilities  are  altered  by  the  system  designers  to  fit  the  new 


structure. 
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Petri  STEPPS 


The  input  port  accepts  N messages  before  changing  state  to  an  output  port}  the 
transition  between  the  output  ports  occurs  in  a sequence;  and  the  last  output  state 
transfers  to  the  input  port. 


Petri  STEPPS 


The  input  state  accepts  only  1 message  and  the  transition  to  each  output  state  is 
equally  likely.  Each  output  state  transfers  to  the  input  state.  The  link  may  be  able  to 
hold  more  than  one  message. 


Figure  1-9.  Mapping  Between  Petri  nets  and  STEPPS  model. 
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UCLA  STEPPS 


The  input  state  accepts  2 messages  before  transferring  to  an  output  state. 

UCLA  STEPPS 


The  link  has  a limit  of  one  message,  so  only  one  message  can  get  to  the  process.  The 
process  input  port  accepts  1 message  before  transferring  to  an  output  state. 

UCLA  STEPPS 


The  transition  matrix  sequences  through  the  two  output  ports. 

UCLA  STEPPS 


The  transition  matrix  shows  an  equal  likelihood  of  transferring  to  each  output  port 
from  the  input  ports.  After  an  output  the  process  will  perform  an  input. 


Figure  I- 10.  Mapping  of  UCLA  model  to  STEPPS. 
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I.E.  The  STEPPS  system  and  simulator 

Once  a proposed  multiprocessing  program  has  been  modeled,  the  model  can  be 
implemented  in  the  STEPPS  interactive  system  in  order  to  evaluate  the  particular 
decomposition.  The  data  entry  language  for  STEPPS  has  been  designed  for 
conciseness.  A linear  description  of  a directed  graph  and  the  associated  transition 
matrices  may  require  the  entry  of  a fairly  large  amount  of  data.  To  facilitate  the  entry 
of  these  ciata,  it  is  possible  to  recall  previously  stored  data.  The  system  designer  can 
manipulate  his  model  in  any  way  he  chooses,  e.  g.  remove  nodes,  change  parameter 
specifications,  or  display  parts  or  all  of  his  model.  It  is  always  possible  to  save  the 
description  of  the  model  or  parts  of  it  externally  in  a form  that  may  be  recalled  by  the 
STEPPS  system  or  examined  on  hardcopy. 

Several  useful  tools  are  available  to  help  the  system  designer  evaluate  the 
structure  of  his  decomposition.  As  a basic  step,  a STEPPS  model  can  be  certified  as 
being  a well-formed  model.  A STEPPS  model  is  well-formed  when: 

1.  For  each  process,  every  state  is  attainable  from  any  other  state  (If  a 
process  has  N states,  and  X and  Y are  any  two  of  them  (possibly  the 
same),  the  probability  of  starting  in  state  X and  entering  state  Y in  N or 
fewer  transitions  is  greater  than  zero.  This  restriction  Is  discussed  In 
later  chapters.)}  and 

2.  All  ports  of  each  process  are  attached  to  links} 

3.  All  links  are  attached  to  both  input  and  output  ports} 

4.  The  graph  is  connected.  (When  the  directions  of  paths  are  ignored  then 
there  exists  a path  between  every  pair  of  nodes.) 

At  some  point  it  should  be  possible  to  simulate  the  execution  of  the  modeled 
program;  thus  the  STEPPS  system  contains  a model  simulator.  However,  there  remain 
problems  which  can  prevent  a successful  simulation  of  a program  structure.  One 
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problem  is  that  the  initial  state  of  the  processes  and  the  initial  message  capacities  of 
the  links  might  be  incompatibie.  This  would  cause  a simulation  to  halt  almost 
immediately.  Another  problem  is  one  of  possible  communication  deadlocks.  These 
problems  are  discussed  in  Chapter  IV. 

I.E.l.  Deadlocks 

A process  may  deadlock  in  either  of  two  situations: 

1.  no  messages  wiii  ever  be  available  at  the  link  attached  to  an  active  input 
port,  or 

2.  the  capacity  of  the  link  attached  to  an  active  output  port  has  been 
reached,  and  no  messages  will  evi>r  be  able  to  leave  the  link. 

Deadlocks  may  occur  when  a process  can  depend  on  itself  improperly.  They 

may  also  occur  when  a set  of  processes  are  incompatible  for  reasons  other  than  data 

loops. 

Example  I.E- 1 

Figure  I-l  1 shows  process  A waiting  for  data  from  B while  B is  waiting 
for  data  from  A.  If  the  initial  state  of  A is  changed  to  be  01  then  the 
process  has  no  deadlocks.  If  an  additional  change  is  made  to  A so  that 
state  01  or  II  is  activated  more  than  once  and  B 's  not  changed,  then 
this  is  again  unsafe  because  a link  will  eventually  overflow  or  never 
have  enough  data. 

Example  I.E-2 

Figure  1-12  shows  a non-ioop  structure  where  there  wiii  be  a deadlock 
as  soon  as  the  LI  queue  limit  is  reached. 

None  of  the  structures  presented  in  Examples  I.E-1  and  I.E-2  showed  problems 
that  can  occur  when  a process  has  a choice  of  successive  states.  There  are  other 
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Figure  1-12.  Incompatible  non-loop.T 

deadlock  producing  structures.  For  example  a process  may  be  set  up  to  produce 
either  N or  M messages  and  the  safety  of  this  structure  must  be  recognizable. 


'’’The  asterisk  in  the  example  means  that  this  is  the  initial  state. 
*01  [2]  means  two  occurrences  of  01  before  changing  state. 
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The  deadlock  problem  may  be  dealt  with  in  two  ways.  One  alternative  Is  to 
require  any  program  decompOt-.Hon  to  be  deadlock-free. 

A second  alternative  is  to  determine  where  deadlocks  may  occur  and  the 
probability  of  a deadlock.  The  existence  of  deadlocks  in  real  systems  is  not  always 
bad  as  long  as  a suitable  response  can  be  made.  For  example,  the  ARPA  network  Is 
not  deadlock  free  [Kleinrock  75].  However,  when  a deadlock  Is  suspected  the  system 
"times  out"  and  requires  reinitialization  of  a data  message.  This  is  a reasonable 
solution  under  some  circumstances,  but  only  when  a system  can  lose  information. 
STEPPS  provides  tools  to  recognize  the  possible  occurrence  of  deadlocks. 

The  algorithms  used  to  identify  deadlocks  are  basically  specialized  graph 
reduction  techniques.  A model  is  viewed  as  a graph  whose  nodes  are  the  processes 
and  links.  Under  application  of  these  reductions,  a safe  model  will  collapse  to  a graph 
containing  no  nodes.  If  the  graph  does  not  collapse  then  a deadlock  is  possible.* 

As  already  noted,  a STEPPS  model  of  a program  can  be  quite  general.  If  a 
model  is  acyclic  and  meets  other  criteria  set  by  Martin  [Martin  69]  it  is  possible  to 
estimate  mean  path  time;  however,  these  criteria  are  quite  restrictive.  In  genera,'.  It  is 
not  possible  to  estimate  mean  path  time  through  a STEPPS  model  without  simulation. 
Ordinary  systems  analysis  techniques  such  as  queueing  theory  and  dynamic 
programming  models  are  intractable  in  all  but  the  simplest  cases  [Fishman  73,  Gordon 
69].  It  is  for  this  reason  that  a simulator  is  e basic  part  of  the  STEPPS  system. 

The  simulator  is  easy  to  use  since  it  is  a specialized  system  and  requires  no 
programming.  Naturally,  any  STEPPS  model  can  be  simulated  using  GPSS,  SJMSCRIPT, 
SIMULA,  or  any  other  simulation  language.  However  the  effort  required  to  reprogram 


^Chapter  IV  discusses  the  deadlock  problem  and  past  work  In  the  area. 
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a general  model  Is  not  well  spent  at  the  design  stage  of  building  a multiprocessing 
program.  It  is  at  this  early  stage  of  program  development  that  the  designer  needs 
Information  about  possible  program  decompositions,  and  the  flexibility  to  be  able  to 
alter  his  design  easily  and  make  new  evaluations.  If  variations  in  the  decomposition 
needed  to  be  reprogrammed,  the  understanding  of  alternative  systems  would  be  a 
more  dif'cult  process  than  comparing  alternative  models  using  the  STEPPS  system. 

A variety  of  simulation  parameters  can  be  easily  altered  for  comparing  their 
effects  on  simulation  results.  These  parameters  include:  restricting  the  number  of 
available  processors,  identifying  processor  competing  and  noncompeting  processes,  and 
varying  process  scheduling  algorithms. 

The  STEPPS  simulator  has  a set  of  data  gathering  functions  which  help  the 
designer  evaluate  a particular  decomposition.  Some  of  the  estimations  that  are  made 
based  on  the  data  are: 

1.  The  expected  time  that  each  process  is  in  each  state.  This  can  be 
determined  without  simulation  if  only  the  processing  time  Is  of  Interest, 
but  when  process  wait  time  is  .included  it  is  too  difficult  to  estimate  the 
time  spent  in  each  state. 

2.  The  expected  number  of  messages  h each  queue. 

3.  The  expected  number  of  processes  waiting  to  send  a message  to  each  link. 

4.  The  expected  number  of  processes  waiting  for  a message  from  each  link. 

5.  The  expected  number  of  processes  that  will  be  executing  simultaneously. 
This  can  be  used  to  estimate  the  number  of  processors  needed. 

This  list  is  not  complete  for  all  uses  of  the  simulator.  The  system  has  been 
designed  so  that  it  is  not  difficult  to  include  additional  measurement  functions. 

The  simulation  times  required  to  obtain  these  estimates  vary  with  the 
complexity  of  a model.  Usually,  useful  estimates  can  be  obtained  with  a few  minutes  of 
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DEC  PDP-10  compute  time.  The  complexity  of  a graph  is  dependent  on  such  attributes 
as  the  number  of  connections,  choice  of  process  states,  and  link  delays. 

! F.  Thesis  contributions  and  outline  of  remainder  of  thesis 

The  contributions  of  this  thesis  are  tools  that  a system  designer  can  use  to 
enhance  the  overall  design  of  a multiprocess  program.  These  tools,  presented  as  the 
STEPPS  system,  are  based  on  a model  that  is  described  precisely  in  Chapter  II. 
Chapter  II  also  discusses  the  STEPPS  system’s  capabilities  (Appendix  A is  a manual  for 
the  STEPPS  system).  Examples  of  how  the  STEPPS  model  can  be  used  to  model  a 
variety  of  multiprocess  structures  are  presented  in  Chapter  III.  In  addition,  Chapter  III 
presents  two  larger  examples:  one  of  the  use  of  the  STEPPS  system  in  a user’s  early 
design  stage  and  the  other  of  the  use  of  the  STEPPS  system  in  system  tuning.  The 
deadlock  reduction  algorithm  is  presented  as  a set  of  theorems  with  proofs  in  Chapter 
IV.  Other  model  analysis  capabilities  are  also  discussed.  The  STEPPS  simulator  and 
data  gathering  facilities  are  discussed  in  Chapter  V.  Chapter  VI  contains  a review  of 
the  thesis  results,  the  limitations  of  this  research,  conclusions  and  directions  for 


further  research. 
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Chapter  II 

The  STEPPS  Model 


This  chapter  provides  some  formalisms  for  later  use  and  a precise  definition  of 
the  STEPPS  model.  Chapter  I presented  an  informal  description  of  the  model  and  the 
interactive  design  environment  based  on  the  model. 

Il.A.  Modeling  the  behavior  of  a process 

The  term  proceit  describes  the  utilization  of  the  processing  unit  of  a single 
instruction  stream-single  data  stream  computer  (SISD).  A "process"  has  sometimes 
been  defined  as  the  execution  of  a program.  For  the  purposes  of  this  research,  that 
definition  is  too  limited,  since  it  does  not  take  into  account  data  transfers  and  accesses. 
A process,  as  defined  for  the  STEPPS  model,  exists  in  one  of  the  following  conditions: 

1.  processing  (computing)  before  performing  an  input  or  output  operation, 

2.  waiting  to  access  an  external  resource  that  must  be  accessed  exclusively 
(simultaneous  accesses  are  modeled  by  allowing  zero  time  between 
accesses),  and 

3.  waiting  to  complete  an  input  or  output  operation. 

A process  is  modeled  as  a processing  unit  which  can  perform  operations 
internally,  and  which  then  must  communicate  with  other  units  through  one  of  several 
ports.  The  communication  occurs  when  a process  'either  requests  or  provides  a unit  of 
information.  Each  port  belonging  to  a process  has  only  one  function:  Input  to  the 
process  or  output  from  the  process. 

The  internal  operations  of  a process  are  unknown  to  an  observer  of  a process. 
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All  that  can  be  determined  is  the  relationships  among  the  activities  of  the  process  s 
ports.  Externally  these  relationships  appear  as  probabilistic  transfers  of  activity  from 
one  port  to  another,  plus  a computation  time  between  port  activities.  In  general,  the 
computation  time  between  any  two  successive  port  activations  is  dependent  on  the 
particular  ports.  Such  process  activities  as  accessing  resources  and  sharing  resources 
are  modeled  in  terms  of  interprocess  connections  and  message  flow. 

As  defined  in  Chapter  1,  the  note  of  a Proce»»  refers  to  the  most  recent 
activation  of  or  attempt  to  activate  a port.  This  was  an  informal  use  of  the  term 
"state"  since,  more  precisely,  a process  can  be  In  the  state  of  waiting  to  activate  a 
port,  activating  a port  (doing  the  port’s  activation),  computing  before  the  next  port 
activation,  etc.  The  imprecise  definition  of  "state"  will  be  used  in  most  contexts,  and  it 

will  be  made  clear  when  the  more  precise  meaning  is  used. 

This  definition  of  the  state  of  a process  is  an  abstraction  based  on  potential 
communications  between  a process  and  other  processes.  In  addition,  the  concept  of 
time  is  included  in  the  model  to  allow  a designer  to  include  processing  time  for 
. computation  during  simulations.  An  important  abstraction  is  that  STEPPS  processes  are 
not  deterministic  since  port  activations  are  based  on  probabilities  and  not  on  a data 
directed  control  structure.  The  disadvantage  in  this  is  the  inability  to  represent 
programs  on  an  instruction  level.  The  advantage  is  'hat  all  potential  communication 

alternatives  are  emphasized. 

The  complete  operation  of  a process  is  described  by  the  following  loop 


(assuming  the  process  starts  in  some  initial  state): 

1 Perform  the  input  or  output  operation  associated  with  the  present  state. 
This  may  involve  waiting  to  access  an  external  resource  and  waiting  for 
the  input/output  operation  to  complete.  Both  waiting  imes  are 
considered  as  time  spent  in  a state  while  not  processing.  This  step  can  be 
repeated  a specified  number  of  times  before  the  next  step. 

2.  Choose  a new  state.  By  a probabilistic  method,  described  below,  a 
successor  state  is  chosen,  but  not  yet  entered. 
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3.  Process  (compute)  for  a length  of  time  as  determined  by  the  transition 
from  the  present  state  to  the  next. 

4.  Enter  the  new  state  and  repeat  1 through  4. 

Given  the  knowledge  of  the  present  state,  probabilities  for  entering  any  of  the 
process’s  states  are  defined.  Since  the  state  of  a process  is  related  to  the  activity  of  a 
port,  probabilities  are  defined  for  potential  successive  port  activations  from  every  port 
activation.  Note  that  the  choice  of  a successor  state  is  dependent  on  the  present 
state.  In  addition,  step  3 above  implies  that  a processing  time  parameter  is  associated 
with  each  transition  and  step  1 suggests  that  possible  communication  time  is  associated 
with  a port  activation. 

Two  restrictive  assumptions  are  basic  to  this  model.  They  are  that  (1)  a 
process  can  not  be  interrupted  (i.e.  the  transition  matrix  completely  describes  a 
process’  activity)  and  (2)  processes  are  neither  created  nor  destroyed  dynamically. 
These  restrictions  are  used  to  keep  the  model  relatively  simple;  they  also  make  it 
possible  to  perform  the  deadlock  test  by  graph  reduction  (Chapter  IV). f The  lack  of 
dynamic  process  creation  and  destruction  can  be  approximated  by  including  multiple 
copies  of  processes,  but  there  is  no  way  to  use  the  STEPPS  system  to  model  process 
Interrupts  and  preemption. 

II.B.  Data  flow  and  links 

The  previous  section  refers  to  units  of  information  that  are  either  requested  or 
produced  by  a process.  A unit  of  information  is  called  a messo#e.  The  number  of 

^These  restrictions  are  examples  of  a tradeoff  between  analysis  and  representations. 
Some  system  structures  might  have  been  easier  to  represent  if  there  were,  for 
example,  typed  messages  or  dynamic  process  creation.  However,  automated  system 
structural  analysis  was  not  found  to  be  feasible  when  these  richer  representations 
were  considered. 
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messages  in  a STEPPS  model  need  not  be  conserved.  Thus  a process  may  successively 
request  messages  from  each  of  two  input  ports,  yield  a single  message  on  an  output 
port,  and  then  request  more  messages  from  an  input  port.  A property  of  a message  is 
that  it  is  only  a token  of  information.  It  does  not  actually  contain  any  information  used 
within  the  model.  A process  can  not  use  the  contents  or  type  of  a message  to  decide 
on  future  activity.  Only  the  existence  of  a message  is  meaningful  to  a STEPPS  process. 
This  restriction  will  be  shown  not  to  affect  substantially  the  class  of  program 
structures  that  can  be  modeled  with  the  STEPPS  model  The  major  restriction  is  that 
processes  are  completely  defined  by  their  transition  matnces  and  can  noi  be 
preempted.  Thus  systems  that  contain  parent/sibling  process  dependencies  where  the 
parent  process  can  stop,  restart,  or  terminate  a sibling  process  can  not  be  modeled. 

Processes  are  connected  via  fink..  Each  port  of  every  process  is  connected  to 
exactly  one  link,  but  a link  may  be  attached  to  several  ports  of  both  input  and  output 
variety.  Messages  enter  a link  from  output  ports  and  leave  a link  going  to  input  ports. 
Requests  for  messages  from  input  ports  are  handled  on  a first  in  - first  out  basis. 

The  link  is  the  resource  that  can  only  be  accessed  by  one  process  at  a time. 
This  access  may  take  *ero  time,  but  the  restriction  is  used  to  prevent  race  conditions. 
For  this  reason  the  STEPPS  model  includes  a method  that  guarantees  mutual,  exclusive 
access  to  a link.  Since  a process  may  only  perform  one  input  or  output  operation  at  a 
time,  it  can  only  access  one  link  at  a time,  so  there  is  no  opportunity  for  a "deadly 

embrace"*  due  to  the  accessing  of  links. 

The  STEPPS  model  can  be  used  to  model  the  situation  where  there  Is  a non- 


zero overhead  for  message  transmission.  The  properties  of  a link  aro- 

"*A  deadly  embrace,  as  defined  by  Dijkstra,  Habermann  and  others,  occurs  when  two 
processing  objects  are  able  to  reserve  more  than  one  resource  at  a time  without  a 
resources  being  reserved  initially.  For  example;  process  A reserves  resource  x; 
process  B reserves  resource  y;  process  A needs  resource  y and  can  not  continue  until 
B relinquishes  it;  process  B needs  resource  x and  can  not  continue  until  A relinquishes 
it.  Neither  process  A nor  B will  be  able  to  continue. 
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1.  It  can  store  a limited  number  of  messages. 

2.  It  may  take  a certain  amount  of  delay  Um«  to  either  accept  or  transmit  a 
message  (same  delay  time  for  accepting  or  transmitting). 

3.  Time  may  be  required  to  start  up  a link  when  it  is  not  already  active  T. 

4.  It  may  initially  contain  a specifiable  number  of  message  tokens. 

5.  It  can  receive  requests  for  messages  and  transmit  a message  to  a 

requestor  if  a message  is  available  or  force  the  requestor  to  wait  in  a 
queue  (whose  size  Is  dependent  on  the  number  of  processes  attached  to 
the  link)  until  a message  becomes  available. 

A link  is  not  a process  but  its  operation  can  cause  timing  delays.  When  a link 
has  a start-up  time  parameter  set  to  be  greater  than  zero  then  the  link’s  start-up  time 
' is  significant.  The  other  reasons  that  a link  can  force  a process  to  wait  in  a state  are: 

1.  The  link  that  is  attached  to  the  current  state’s  port  is  already  in  use. 

2.  The  link  has  reached  its  limit  of  messages  and  the  current  state’s  port  is 

an  output  port. 

3.  The  link  has  no  messages  and  the  current  state’s  port  Is  an  input  port. 

4.  The  link's  defined  delay  time  is  taken  to  perform  an  input/output 

operation. 

The  complete  operation  of  a link  in  the  STEPPS  model  Is  described  by  the 
following  loop: 

1.  Do  nothing  untii  a process  requests  the  use  of  the  link.  Wait  for  a specific 
start-up  time  (if  any). 

2.  If  the  request  is  for  the  link  to  accept  a message  and  if  the  link’s  specified 
message  limit  has  not  been  reached,  then  accept  the  message.  Otherwise 
do  nothing,  forcing  the  process  trying  to  send  a message  to  wait  until  a 
message  is  removed  from  the  queue. 

3.  If  the  request  is  for  the  link  to  provide  a message  and  if  there  are  any 
messages  available,  then  send  a message  to  the  process  requesting  a 
message.  Otherwise  do  nothing,  forcing  the  process  requesting  a message 
to  wait  until  a message  is  sent  to  the  link. 

4.  Wait  a specified  amount  of  time  (if  any)  for  data  to  transfer. 


*A  similar  situation  occurs  in  a virtual  memory  system  when  extra  time  Is  necessary  to 
bring  a page  that  is  not  currently  in  use  into  main  memory. 
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5.  Aiiow  the  process  that  is  currently  accessing  the  link  to  continue. 

6.  If  e process  is  waiting  for  a message  or  waiting  to  send  a message  then 
repeat  2 to  6 (the  queue  discipline  Is  FIFO).  Otherwise  repeat  1 to  6. 

II.C.  Notation  and  definitions 

The  notation  that  wiii  be  used  in  the  remainder  of  this  thesis  is  described  here. 
Wherever  possible  the  linear  notation  will  be  the  same  as  that  used  as  the  command 
language  and  display  language  for  the  STEPPS  system.  (See  Appendix  A for  complete 
definitions  and  explanations.) 

The  attributes  associated  with  a process  are:  its  ports,  the  links  attached  to 
the  ports,  its  transition  matrix,  its  initiai  state,  and  the  number  of  repetitions  of  each 
state  that  occurs  before  the  process  chooses  a new  state.  The  attributes  of  a link  are: 
the  ports  attached  to  it,  its  queue  size  iimit,  initiai  number  of  messages  in  its  queue, 
time’  to  accept  or  send  a message  (delay  time),  and  the  time  to  restart  a link  that  has 
been  waiting  for  activity. 

II.C.l.  Notation 

The  foiiowing  informal  and  incomplete  "INF  defines  some^  of  the  syntax  of  the 
STEPPS  system  used  to  describe  the  attributes  of  the  process  and  iink  nodes.  The 
usuai  definitions  for  ietter,  number,  digit,  and  other  non-terminals  with  common 
descriptive  names  are  assumed. 

Generaiiy  used  terms: 

<name>  <letter>  | <name>  <digit>  | <name>  <letter> 

<process  name>  ::■  <name> 

*Some  examples  wiii  use  syntax  not  shown,  such  as:  everything  to  the  right  of  T is 
ignored  and  the  words  Attribute,  Queue,  Volume,  etc.  can  be  abbreviated.  The 
complete  syntax  is  defined  in  Appendix  A. 
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<llnk  name>  <name> 

<port  name>  ::•  <process  name>.<port  type><up  to  3 d!g!ts> 

<port  type>  I 1 0 

<input  port>  <process  name>.l<up  to  3 digits> 

<o ut put  port>  <process  name>.0<up  to  3 dlgits> 

Connections  between  ports  (simple  connections): 

<connection>  <lnput  port>«-<llnk  name>  | <llnk  name>«-<output  port> 

Transition  matrices: 

transition  definition>  ::-  <port  name><repetition  fac»or>  - <initlal 

state><transltlon  probabilities  and  times> 

<repetitlon  factor>::-  <null>  | [<posltive  integer  less  than  262144>] 

<initial  state>  <null>  | * 

transition  probabilities  and  times>  <port  id,  prob.,  compute 

time>  | <port  Id,  prob.,  compute  time>;<transition 
probabilities  end  t»mes> 

<port  id,  prob.,  compute  time>  ::■  <port  type>  <up  to  3 digits>:  <prob  comp> 
<prob  comp>  ::-  <probabllity>|<probability>,<compute  time> 

<probability>  ::-  <real  number  between  0 and  1> 

<compute  tlme>  ::-  <a  non-negative  real  number>|<null> 

Link  attributes: 

<link  attributes>  ::-  Attributes  dink  name>  <list  of  attribute  definitions> 

<| | s t of  attribute  definitions>  <attribut#  definition>  | 

cattribute  definition,  <list  of  attribute  definitions* 

<attribute  definition  <attribute  name>  : <number> 

<attribute  name>  Queue  | Volume  | Delay  | Startup 


Example  II.C-l 

ALPHA,  L3,  L7,  and  GAMMA  are  legal  process  and/or  link  names. 
Consider  the  following  STEPPS  commands: 

ALPHA.I1  *•  L3 
L7  «-  ALPHA.02 

Attributes  L3  Queue:7,  Volume:3,  DelayK).5,  Startup:2.5 
GAMMAI2[  3 ]-  11:  .4,  3.5;  12:  0;  04:  .6,  1.5 
GAMMA.04  -•  12:  .5;  04:  0.5,  7.5 

The  first  two  lines  are  examples  of  the  notation  for  connections.  The 
third  line  displays  the  attributes  of  a link.  The  last  two  lines  show  how 
transition  probabilities  are  represented.  Thus  the  probability  of 
entering  GAMMA.04  from  GAMMA. 1 2 is  0.6  and  will  take  1.5  units  of 
time.  All  STEPPS  displays  will  order  the  ports  of  a process  in  numerical 
order  with  input  ports  before  output  ports.  In  addition,  missing 
parameters  are  defaulted  (e.g.,  GAMMA.il  probabilities). 
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Figure  II-l.  Process  and  link  graphical  notation* 

Only  one  port  of  a process  will  have  a * when  a process’s  entire  transition 
matrix  is  displayed. 

A graphic  notation  used  in  later  sections  and  chapters  is  shown  in  Figuro  11-1 
of  the  last  example.  A process  is  a convex  figure  and  will  be  represented  by  either 
boxes  or  circles.  Links  will  always  be  represented  by  straight  lines.  Connections  will 
be  represented  by  lines  with  arrow  heads  denoting  the  direction  that  a message  would 
flow. 

Chapter  III  contains  an  example  set  of  simple  and  complex  STEPPS  models  of 
program  communication  structures.  These  examples  demonstrate  that  the  STEPPS 
model  is  expressive  enough  to  represent  both  toy  and  non-toy  structures  while 
eliminating  the  details  required  by  programming  languages  and  the  details  required  by 
a Petri-net  like  model. 


*Not  all  of  the  attributes  of  a process  or  a link  will  be  displayed  in  later 
examples. 
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II.C.2.  Summary  of  parametora  to  tho  STEPPS  modol 


The  following  is  a complete  list  of  the  parameters  that  must  be  supplied  for  a 
STEPPS  model:* 

1.  A connection  betw-*r  each  process  port  and  a iink.  Default  port 
connections  are  to  link  "DANGLING". 

2.  A transition  matrix  for  each  process  showing  the  probability  of  entering  a 
new  state  from  each  state  and  the  amount  of  processing  time  taken  before 
the  transition.  Default  probability  values  are  determined  by  assigning 
equal  parts  of  any  unassigned  probability  to  each  defaulted  transition. 
Default  compute  times  are  zero. 

3.  The  initial  state  of  each  process  (04*).  The  first  port  defined  is  tho 
defaulted  initial  state. 

4.  The  number  of  times  a port  activation  can  repeat  before  a new  state  Is 
entered  (I2[3]).  Default  is  1. 

5.  The  maximum  queue  length  allowed  for  each  link  (Q-.7).  Default  is  1. 

6.  The  initial  number  of  messages  in  each  queue  (V:3).  Default  is  0. 

7.  The  delay  time  caused  by  the  operation  of  each  iink  (D:2.5).  Default  is  0.0. 

8.  The  start-up  time  to  wait  when  using  a link  not  already  in  use  <SK).5). 
Default  is  0.0. 


II.C.3.  Graph  definitions 

The  STEPPS  model  is  a graphical  model  and  thus  some  abstractions  have 
proven  useful  in  discussing  the  model.  When  a graphical  structure  is  similar  to  that  of 
classical  graph  theoretical  abstractions,  the  classical  structure  name  has  been  used*. 
Some  useful  definitions  are: 

Node  — A node  is  either  a process  node  or  a link  node. 

*The  STEPPS  system  assumes  default  values  for  some  of  the  parameters.  Examples 
refer  to  Figure  II- 1. 

*Many  o<  the  abstractions  are  based  on  the  text  by  Berge  [Berge  62J. 
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Path  — A path  between  two  nodes  is  a sequence  of  nodes  with  each  node  connected 
to  the  next  one  in  such  a way  that  a process  is  connected  by  an  output  port  to 
a link  that  is  connected  to  an  input  port  of  the  next  process  in  the  path.  There 
may  be  many  paths  between  any  pair  of  nodes.  A path  may  include  alternate 
branches  as  long  as  each  branch  leads  to  the  final  node  of  the  path. 

Adjacent  — An  input  port  and  an  output  port  are  adjacent  if  they  are  both  connected 
to  the  same  link  and  no  other  ports  are  connected  to  that  link. 

Attached  to  — A port  is  said  to  be  attached  to  a link  if  it  is  connected  directly  tc  tla 
link.  An  input  or  output  port  is  attached  to  a (possibly  different)  process  node 
if  the  port  is  attached  to  a link  that  is  attached  to  the  process  by  a link  of  the 
opposite  type  In  particular,  there  must  be  a p«»th  between  the  port  and  the 
process  through  only  one  link. 


1I.C.4.  State  definition* 


The  structure  of  a process  is  described  by  potential  transitions  among  the 
states.  The  following  abstractions  are  used  when  discussing  the  properties  of  states 
of  a process: 


ln-tequence  — A subset  of  the  states  of  a process  is  said  to  be  in-sequence  if  the 
transition  matrix  of  the  process  shows  that  once  the  process  enters  one  state 
of  the  set  then,  with  probability  1,  the  process  will  enter  the  other  states  of 
the  set  in  a particular  sequential  order.  In  addition,  no  other  state  of  the 
process  may  transfer  to  any  of  the  elements  in  the  sequence  other  than  the 
first  state. 

Onio  — State  x is  onto  state  y if  for  any  sequence  of  transitions  starting  at  x and 
terminating  at  the  first  occurrence  of  y,  state  x is  not  reentered. 

One-to-one  — is  a relationship  between  two  states  of  a process  occuring  when  the 
only  way  for  a state  to  recur  Is  to  enter  the  other  state  exactly  once  and  vice 
versa.  State  x is  one-to-one  with  state  y if  x is  onto  y and  y is  onto  x. 

Immediate-recurrent  — A state  is  immediate-recurrent  if  it  can  return  to  itself  In  one 
transition.  The  process  may  return  to  the  immediate-recurrent  state  without 
entering  any  other  state. 


nil 


II. D.  STEPPS  eyetem  capabilities 

The  STEPPS  system  Is  designed  for  Interactive  use.  It  contains  facilities  to 
enter,  manipulate,  display,  save  and  retrieve  the  description  of  a model.  There  are 
facilities  to  test  the  legality  and  consistency  of  a description.  There  Is  a facility  for 
the  automatic  recognition  of  possible  deadlocks.  In  addition,  the  STEPPS  system 
contains  a parameterizable  model  simulator  and  facilities  to  display  or  copy  the  data 
gathered  during  a simulation. 

The  notation  defined  earlier  in  this  chapter  is  used  both  to  enter  a model 
description  and  to  d splay  the  model.  The  displays  available  include  processes  and  link 
connections,  and  transition  values  for  a port  and  for  a process.  All  possible  paths 
between  any  two  processes  can  be  displayed,  but  this  is  a very  expensive  operation 
and  not  recommended  because  of  large  memory  requirements. 

Another  feature  of  the  '"'EPPS  system  h that  it  has  been  designed  to  facilitate 
application  of  analysis  programs  that  might  be  defined  externally  to  the  STEPPS 
systemT  Such  analysis  programs  could  i written  in  Sail  [VanLehn  71],  Bllss/10  [Wulf 
71],  or  FORTRAN.  These  program  be  abb  io  operate  on  process  transition 

matrices,  on  process  c?'  tion  matrices,  and  on  the  graph  connection  matrix.  The 
incorporation  of  externaiiy  defined  functions  necessitates  a reconfiguration  (a  new 
LOAD)  of  the  STEPPS  system,  but  no  program  modifications  are  required. 


f The  details  of  doing  this  are  presented  in  Appendix  A. 


Chapter  III 

The  Use  of  the  STEPPS  Approach  to  Program  Design 


This  chapter  presents  examples  using  the  STEPPS  model  and  the  STEPPS 
system.  These  examples  demonstrate  that  the  model  is  rich  enough  to  represent 
several  standard  program  communication  structures.  One  example  demonstrates  how 
the  STEPPS  system  can  be  used  in  the  Initial  design  of  a program  and  another  example 
demonstrates  how  STEPPS  can  be  used  to  analyse  and  help  tun.  a multiprocessor 
program  that  Is  under  construction  and  was  designed  without  using  the  STEPPS 

system. 

III. A.  Use  ef  *he  STEPPS  model 

The  STEPPS  modeling  schema  can  be  used  to  represent  a variety  of  program 
constructs.  The  program  designer  controls  the  amount  of  detail  be  wishes  to  include  in 
a model.  Since  the  STEPPS  model  has  been  shown  to  be  able  to  represent  the  detail 
of  both  the  UCLA  and  Petri  net  models,  It  can  be  used  to  represent  programs  at  the 
same  operation  level  as  those  models.  However,  STEPPS  Is  intended  to  be  used  to 
depict  a decomposition  at  a mor,  modular  level  which  more  closely  represents  a 
functional  system  decomposition. 

As  a consequence  of  the  STEPPS  model  being  a communications  structure 
model,  programming  details  such  as  specific  data  dependent  branching,  indefinite  (but 
Unite)  looping,  case  statements,  and  assignment  statements  ere  not  Intended  to  be 
modeled.  Thus  the  following  examples  will  demonstrate  that  the  STEPPS  mode' 
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abstrtction,  which  is  very  much  less  expressive  (or  powerful)  than  a programming 
language  and  more  r ^ressive  than  the  simpler  Petri-net  or  UCLA  model,  has  the 
expressive  richnes-  jdel  some  real  program  structures. 

III.A. 1.  Fork  and  join 

Informally,  the  ability  for  the  STEPPS  model  to  represent  multiple  data  paths 
has  already  been  demonstrated.  The  situation  is  that  one  process  can  cause  more  than 
one  other  process  to  commence  processing  (Conway’s  "fork"  [Conway  66]).  After 
some  concurrent  processing,  the  data  paths  may  unite  and  processing  again  occurs  in 
only  one  processing  unit  (Conway’s  "join").  There  are  several  ways  to  model  fork  and 
join.  Figure  III- 1 shows  one  method.  Process  FORK  sends  a message  to  both  process 
UP  and  process  DOWN.  In  turn,  they  send  messages  to  process  JOIN1.  JOIN1  must 
receive  a message  from  UP  before  it  requests  a message  from  DOWN. 


FORK.I1- 

* 01:1.0, t 

J0IN1.I1- 

* I2:1.0,t 

FORK.Ol- 

02:1.0 

J0IN1.I2- 

01: 1.0, t 

F0RK.02- 

11:1.0 

J0IN1.01- 

11:1.0 

UP.I1- 

* 01:1.0, t 

D0WN.I1- 

♦ 01:1.0, t 

UP.Ol- 

11:1.0 

D0WN.01- 

11:1.0 

Figure  III- 1 . Fork  and  join  processes 
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III.A. 2.  Subroutine  processes 

A subroutine  process  Is  a program  that  can  be  shared  among  several  different 
processes.  In  terms  of  a STEPPS  model  a subroutine  is  a process  that  accepts 
messages  from  another  process;  performs  some  computation  and  then  sends  a message 
back  *o  the  calling  process.  Since  messages  do  not  contain  any  identification  nor  any 
other  information,  the  subroutine  can  not  direct  a resulting  message  back  to  the  caller 
process.  Instead  a technique  is  used  whereby  the  caller  waits  for  a response  from  the 
subroutine  before  it  proceeds.  Figure  III-2  shows  a graphical  representation  of  the 
subroutine  SUBR  and  the  process,  CALLER,  that  calls  the  subroutine.  CALLER  calls 
SUBR  by  sending  a message  to  link  SU8IN.  As  soon  as  the  message  is  accepted 
CALLER  waits  for  a reply  from  link  SUBOUT.  Within  this  model  each  process  that  wants 
to  use  the  subroutine  waits  its  turn  to  send  a message  to  SUBR.  Once  the  process 
sends  its  request  to  the  subroutine  it  waits  for  a reply  from  the  link  SUBOUT.  The 
timing  parameters  of  the  subroutine  and  the  caller  represent  the  action  of  a caller  that 
does  no  processing  concurrently  with  a subroutine  process.^ 

A subroutine  process  can  also  be  called  while  the  caller  process  continues 
processing  concurrently.  This  situation  is  modeled  slightly  differently  than  the  one 
above.  The  difference  is  due  to  the  requirement  that  the  caller  process  receives  the 
reply  corresponding  to  its  original  request.  Otherwise  a second  process  could  receive 
a reply  before  the  subroutine  computes  long  enough  to  request  its  processing,  i.e.  the 
second  process  receives  the  reply  corresponding  to  the  first  process  initialization. 
This  problem  exists  because  messages  (as  defined  in  the  STEPPS  model)  do  not  contain 


*An  implication  of  this  method  is  that  there  is  no  guarantee  that  the  calling  process 
receives  the  result  of  its  call  to  the  subroutine.  However  if,  by  convention,  all  calling 
processes  take  no  time  before  requesting  their  respective  results,  no  problem  ensues 
because  requests  to  and  from  the  subroutine  will  occur  in  the  same  order. 
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±JjL 


A 

0* 

CALLER 

lx 

II 

SUBR 

01 

fa..  fa  ^ 

T 


SUBIN 
Qutu*  2 1 


SUBOUT 
Qu*u*  • 1 


CALLER.Ox  ■ Ix:1.0,0,0  ! wait  for  response,  no  concurrent  computation 

SUBR.I1  - 01:1.0,t  ! t is  subroutine  compute  time 

SUBR.Ol  - 11:1.0,0.0  ! Wait  to  be  called  again 


Figure  III-2.  Subroutine  process 

information  and  processes  do  not  direct  messages  to  other  processes,  only  to 
connected  links.  A solution  is  to  introduce  an  intermediate  process  whose  only 
function  is  to  call  the  subroutine  and  wait  for  a response.  This  is  shown  in  Figure  III- 
3.  CONCAILER  continues  to  process  before  eventually  requesting  a reply  from  port  Ix. 
It  is  necessary  that  0X  be  onio  Ix,  i.e.,  once  a message  is  sent  from  port  0X  eventually 
a message  will  be  requested  at  lx>  The  process  INTER  will  actually  perform  the 
subroutine  call  in  the  same  manner  as  shown  in  Figure  I1I-2. 


1II.A.3.  Poisson  processes  and  general  service  time  processes 

Typically,  queueing  theory  models  contain  assumptions  concerning  the  flow  of 
messages  within  a system  of  message  processors.  These  assumptions  concern 
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SUBIN 

Queue  1 


SUBOUT 

Queue  - 1 


CONCALlER.Ox  - Ix:p,t  ! P S 1 


INTER.il  -*  01:1.0 
INTER.Ol  - 12:1.0 
INTER.I2  - 02:1.0 
INTER.02  - 11:1.0 


Figure  III-3.  Concurrent  processing  subroutine  call 

processing  rates  and  take  the  form  of  assigning  processing  time  as  a random  variable. 
The  STEPPS  system  models  a single  processing  time  related  t-  a given  state,  but  it  is 
possible  to  approximate  a processing  rate  taken  from  some  probability  distribution. 

The  method  used  to  approximate  the  production  of  messages  with  an 
Interarrival  rate  taken  from  a known  probability  distribution  is  as  follows: 

1.  Let  f be  the  probability  density  function  of  the  given  distribution.  Choose 
n to  be  the  granularity  of  the  approximation. 

2.  Divide  the  range  of  f into  n distinct  intervals  Ij, . . .,  In. 

3.  P|  - f(t)dt  This  Is  the  probability  of  t being  In  the  Interval. 

4.  t,  - <SI|tf<t>dt)/<pi) 
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This  is  the  expected  value  of  t in  the  interval. 

Let  the  process  POISSON  send  messages  to  l!nk  LJNK  »nd  [or™  th# 
connections  LINK«-P0ISS0N.01, ....  LlNK*-POISSOMOn.  See  Figure  (III  4). 

The  transition  matrix  for  process  A is  defined  by: 

POISSON.Ox  - Ojt  Pj,  t|  for  x,  i-  1, ....  n. 


POISSON 

01  02  0B  | 


y y . . . V 


LINK 


Figure  III-4.  Poisson  arrival  process 

An  example  of  this  technique  can  be  used  to  approximate  a Poisson  arrival  rate 
In  the  following  manner.  The  density  function  for  an  exponential  rate  between  sending 

messages  with  mean  X is  (1/X)e 

Choose  a value,  a,  for  the  probability  of  the  start  of  the  distribution.  Thus 
« - ^U/X)e-‘/x  dt 

which  implies  that  the  maximum  value  for  t is  tmax  - -XlnU).  The  interval  [tmax,oo)  Is 
one  interval  and  that  the  remaining  interval,  [0,tmax),  is  divided  into  n-1  other 
intervals.  For  convenience,  the  division  will  be  into  uniform  Intervals  of  size  w - 

^tmax>/(n"1>,t  Thus  ths  valueS  <0r  the  prob,bilit'es  for  inlerval6  through  *n-l  *r,: 

Pi.fVtV'Adt-.-^^-e-^/X. 

1 ;i«\v 

The  values  for  the  times  for  intervals  Ij  through  In.j  are: 

. (‘'-‘tete-l/X  dl  - «M).w*X)  . (i*w+X)  e-'*wA  . 

When  X - 260, « - 0.001,  and  n - 10,  the  values  for  Pj  and  tj  are: 

tAn  example  of  a non-uniform  interval  will  be  shown  in  a later  section  of  this  chapter. 

*The  STEPPS  system  has  a feature  to  automatically  determine  the  probability  values 
and  time  given  these  parameters. 
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A.0X  ■ 01:  .535,  87.138}  02:  .249,  286.696}  03:  .115,  486.253}  04:  .054,  685.81} 
05:  .025,  885.368 

A.0X  - 06:  .016,  1084.925}  07:  .005,  1284.482}  08:  .002,  1484.041}  09:  .001, 
1683.604}  010:  .001,  2056.011 

In  a similar  manner,  any  arrival  rate  at  a link  (e.g.  to  link  ALPHA  above)  can  be 
approximated  using  the  STEPPS  model. 

A general  service  time  process  can  also  be  approximated  using  the  STEPPS 
model  (Figure  III-5).  The  transition  matrix  for  the  general  service  time  process, 
GENERAL,  is  defined  by: 

GENERAL.il  - 0}:  pj(  tj  and  GENCRAL.Oj  - II:  1.0,  0.0 


II 

GENERAL 
Of  02  ...  o„ 


V V 


Figure  III-5.  General  service  time  process 


III.A.4.  Pipeline  of  processes 

One  convenient  structure  for  asynchronous  multiprocessing  is  a pipeline 
consisting  of  a set  of  processes  organized  so  that  the  results  of  one  process  form  the 
data  for  the  next  process.  Multiprocessing  occurs  when  there  are  data  in  each  of 
several  processes  in  the  pipeline.  Figure  III-6  shows  the  general  structure  of  a 
pipeline  of  processes.  At  one  end  is  a source  of  data  units  (process  A)  and  at  the 
other  end  is  a sink  for  processed  data  units  (process  F).  Connected  in  between  the 
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,wo  .re  oroce.se,  each  ot  which  he,  input  port,  all  etfched  to  on.  link  end  output 
port,  .it  attached  to  another  link.  Since  the  result,  o.  one  process  are  the  data  tor 
the  next,  each  link  between  processes  is  connected  to  input  ports  ot  one  process  and 
output  ports  ot  a second  process.  Historically,  structures  similar  to  a pipehne  have 
been  success'ully  studied  using  queueing  models  [Kleinro'k  75j  A STEPPS  model 
obtains  results  pertaining  to  this  structure  by  means  of  simulation. 


III.A.5.  Synchronization 


A multiprocessing  program  may  contain  process  configurations  that  require 
synchronization.  One  of  the  better-known  synchronization  primitive  sets  is  Dijkstra’s  P 
and  V operations  on  a semaphore.  It  is  possible  to  model  this  behavior  with  the 
STEPPS  model.  A process  implements  a P operation  by  sending  a message 
10CKSEM  link  and  then  waiting  for  a responding  message  before  continuing  (i.e. 


for  a response  from  LOCKEDSEM  link).  Likewise  a V operation  corresponds  to  sending 


a message  to  an  UNLOCK  link.  The  STEPPS  model  would  be: 


LOCKSEM+-PROCESS.0100 
PROCESS.  1 100«-L0CKEDSEM 
PROCESS.OIOO-  1100:1.0 

PROCESS. 1100*  other  ports 
UNL0CKSEM«-PR0CESS.0101 


! Attach  to  the  lock  semaphore 

1 After  performing  a lock, 

! wait  for  a response  before  continuing. 

j Attach  to  unlock  semaphore 


The  notational  definition  of  the  synchronization  processes  is  a:  Allows 
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LOCKPROCESS.U«*LOCKSEM 
LOCKPROCE$S.I2«-SEMAPHORE 
L0CKEDSEM+-L0CKPR0CESS.01 
LOCKPROCESS.il  - *12:1.0 
LOCKPROCESS.I2  - 01:1.0 
LOCKPROCESS.Ol  - 11:1.0 
UNLOCKPROCESS.il  «-UNLOCKSEM 
SEMAPH0RE*-UNL0CKPR0CESS.01 
UNLOCKPROCESS.il  -*  01:1.0 
UNLOCKPROCESS.Ol  - 11:1.0 


! Obtain  message  from  semephor* 

! Let  process  performing  lock  continue 
! Wait  for  next  lock  request 


! Add  one  to  semaphore 
I Wat:  i >r  more  unlocks 


Attributes  SEMAPHORE  Queue:n,  Voiume:l 

! n is  madmum  value  for  semaphore 
! Initial  volume  of  1 allows  first  lock  to  get  through. 


This  technique  is  almost  an  exact  analogy  to  Dijkstra’s  semaphores  in  that  the 
number  of  messages  residing  in  the  SEMAPHORE  link  determines  the  number  of  LOCK 
operations  that  can  be  performed.  The  difference  is  that  there  is  a limit,  n,  of  possible 
locks.  The  use  of  UNLOCKPROCESS  and  UNLOCKSEM  link  is  redundant.  The  process 


could  be  attached  to  SEMAPHORE  instead  of  UNLOCKSEM: 

SEMAPH0RE+-PR0CESS.0 1 0 1 f Attach  to  unlock  the  semaphore. 

The  graphic  structure  of  the  iock/un!ock  processes  is  shown  in  Figure  III-7. 

A second  example  of  a synchronization  problem  is  th*  Reader/Writer  problem. 
Th*  problem  is  to  aiiow  multiple  reader  processes  to  be  able  to  pass  through  a lock, 
but  to  exclude  ail  writers  so  long  as  any  reader  is  not  complete.  Once  a writer 
process  tries  to  perform  a lock  other  readers  and  writers  are  not  permitted  until  after 
the  writer  has  performed  an  unlock.  Naturally,  the  writer  process  doe6  not  proceed 
until  all  readers  have  completed  their  read  unlocks.  The  solution  to  this  problem 
requires  three  processes:  READLOCK,  WRITELOCK,  and  WRITEUNLOCK  (Figure  III-8).  A 
reader  process  will  send  a message  to  the  PEADLOCK  process  and  wait  for  a reply 
from  the  READLOCKED  link  before  continuing.  Likewise,  a writer  process  will  send  a 
message  to  the  WRITELOCK  process  and  wait  for  a reply  from  the  WRITELOCKED  link 
before  continuing.  The  link  RWLINK  initially  contains  N messages.  Each  reader  will 
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Figure  III-7.  Lock/Unlock  synchronization 

cause  one  message  to  be  removed  from  RWLINK.  Thus  there  can  be  a maximum  of  N 
simultaneous  readers  before  any  reader  is  blocked.*  The  WRITELOCK  process  requests 
all  N messages  from  RWLINK  before  it  allows  a writer  process  to  continue.  When  there 
are  already  reader  processes  that  have  requested  messages  from  the  RWLINK, 
WRITELOCK  will  wait  until  all  current  readers  have  performed  a read  unlock  by  sending 
a message  to  RWLINK  (each  such  message  will  be  requested  by  WRITELOCK).  After 
WRITELOCK  has  all  of  the  messages  that  were  at  RWLINK  it  allows  a writer  process  to 
proceed.  No  reiders  can  proceed  si  rce  there  will  be  no  messages  at  RWLINK  until  a 
write  unlock  is  performed  by  causing  WRITEUNLOCK  to  send  N messages  to  RWLINK 

*As  with  the  PV  model,  there  is  only  a finite  number  of  possible  readers.  This  Is  not  a 
problem  because  the  STEPPS  model  does  not  include  dynamic  creation  of  processes. 
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end  service  to  processes  swsltlng  at  a link  Is  FIFO.  Only  one  writer  process  can  pass 
the  lock  since  each  would  cause  N messages  to  be  requested  from  RWLINK  and  there 
can  never  be  more  than  N messages  there. 


Readlock 

Readunlock 

Wrlteunlock 


Writelock 


Readlocked 


Wrltelocked 


READL0CK.I2«- RWLINK 
WRITEL0CK.I2«-RWLINK*-WRITEUNL0CK.0 1 

READLOCK.il- 

♦ 12:1.0 

! Request  a message  from  RWLINK 

READL0CK.I2- 

01:1.0 

! Allow  a reader  to  proceed 

READL0CK.02- 

11:1.0 

! Walt  for  another  read  lock 

WRITEL0CK.il- 

* 12:1.0 

! Request  message  from  RWLINK 

WRITEL0CK.I2[N]- 

01:1.0 

! After  requesting  N messages 

WRITEL0CK.01- 

11:1.0 

1 from  RWLINK,  allow  a reader  to  proceed 
! Walt  for  another  write  lock 

WRITEUNLOCK.il- 

*01:1.0 

I Send  messages  to  RWLINK 

WRITEUNL0CK.0 1 [Nl— 

11:1.0 

I After  sending  N messages  to 

Attribute  RWLINK  QueueiN,  VolumeiN 

I RWLINK,  wait  for  next  writer  unlock 

Figure  III-8.  Reader/Writer  Synchronization 
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III.B.  Using  STEPPS  during  system  design:  A Bliss/1 1 compiler 

Bliss/ll  [Wulf  72a]  Is  a system  implementation  language  designed  for  the  DEC 
PDP-11  computer.  Its  only  compiler  is  an  optimizing  cross  compiler  Implemented  on 
the  DEC  PDP-10.  The  language  has  been  used  as  the  implementation  language  for  the 
Hydra  operating  system  [Levin  75,  Wulf  75b]  for  the  C.mmp  computer,  as  well  as  for 
other  PDP-11  systems  programs. 

There  are  several  reasons  why  a Bliss/11  compiler  Is  an  appropriate  program 
to  Implement  on  a multiprocessor  (C.mmp).  First,  since  Bliss/11  is  the  system  language 
for  Hydra  and  C.mmp,  it  should  be  available  on  the  Hydra  system  to  make  C.mmp  self- 
sufficient.  In  addition,  the  mechanism  for  moving  programs  between  the  two  computers 
is  a time  consuming  and,  presently,  awkward  arrangement.  A second  reason  is  that  the 
Bliss/il  compiler  is  very  large  and  slow.  The  compiler  requires  a large  amount  of 
PDP-10  memory  to  do  even  small  compilations.  A third  reason  is  that  the  internal 
structure  of  the  Bliss/11  compiler  [Wulf  75a]  consists  of  separate  phases  that  could 
possibly  be  divided  into  separate  processes^.  Thus  a Bliss/ll  compiler  is  a program 
that  can  be  considered  for  implementation  on  a multiprocessor. 

The  STEPPS  system  will  be  used  to  predict  how  a Bllss/11  Implementation 
might  perform  as  a multiprocess  program.  Possible  structures  for  the  compiler  and 
structural  refinements  will  be  discussed. 

III.B. 1.  An  overview  of  the  structure  of  Bliss/1 1 

The  Bliss/11  compiler  is  divided  into  seven  relatively  independent  phases 
(Figure  III-9).  The  Lj’s  in  the  figure  refer  to  intermediate  representations  of  data 
passed  between  the  phases. 

*This  conjecture  has  been  discussed  with  the  authors  of  Bllss/11  [Wulf  75a]. 
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The  following  is  a description  of  the  compiler  [Wulf  75a] 


*: 


i 


...  the  subroutine  is  the  program  unit  to  which  each 
physical  phase  is  applied.  Thus  the  source  text  for  an  entire 
subroutine  is  read  and  the  phase  LEXSYNFLO  applied  to  it, 
producing  Intermediate  form  Lj.  In  turn  DELAY,  TLA,  ...,  and 

FINAL  are  applied  to  the  intermediate  representations  Lj,  L2 

Lg  for  the  same  subroutine,  producing,  respectively,  L2»  l-3>  •••» 
L7.  The  next  subroutine  is  processed  only  after  all  phases  have 
been  applied  to  its  predecessor.  A consequence  of  choosing  the 
subroutine  as  the  unit  to  which  successive  phases  are  applied  Is 
that  optimizations  are  applied  to  this  units  i.e.,  no  optimizations 
are  applied  which  involve  detailed  structural  knowledge  of  more 
than  one  subroutine  simultaneously. 

The  general  attributes  of  the  major  phases  are 
summarized  below  . . . 

LEXSYNFLO  This  phase  performs  lexical  analysis,  declaration 
processing,  syntax  analysis,  and  flow  analysis. 
The  Input  is  the  source  program  unit  in  character 
string  form.  The  output  consists  of:  (1)  a set  of 
symbol  table  entries,  (2)  a tree  representation  of 
the  parsed  program  unit,  and  (3)  a set  of  lists 
(generally  threads  running  through  the  tree) 
which  define  feasible  global  optimizations 
(constant  expressions  whicS  may  be  moved  out  of 
loops  and  the  like). 

DELAY  Delay  has  three  primary  functions:  (1)  to 

determine  the  "general  shape"  of  the  object  code 
to  be  generated,  (2)  to  estimate  the  "cost"  of  each 
(linear)  program  segment,  and  (3)  to  determine  the 
evaluation  order  for  expressions.  By  the  "general 
shape"  of  the  object  code,  we  mean  those 
properties  of  the  operators  (e.g.,  commutativity) 
or  properties  of  the  target  machine  (e.g.,  indexing) 
which  may  be  used  to  simplify  the  computation  of 
a value.  Decisions  are  also  made  at  this  point  as 
to  whether  any  (or  all)  of  the  "feasible"  global 
optimizations  are,  in  fact,  desirable.  Actual 
machine  codo  Is  not  generated;  rather  various 
flags  and  fields  are  set  to  guide  local  code 
generation  in  a later  phase.  The  cost  metric  is 
used  to  guide  selection  of  evaluation  order  and  in 
register  allocation.  The  output  of  this  phase  Is 
identical  to  that  of  LEXSYNFLO  (i.e.,  symbol  table, 
tree,  etc.)  except  that  certain  information  has 


^Reproduced  with  permission. 
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been  added  to  the  tree  to  signal  the  subsequent 
phases  of  the  compiler  concerning  the  shape,  cost, 
and  execution  order  of  the  code  to  be  generated. 

TLA,  RANK,  PACK 

The  function  of  these  phases  is  what  in  Ot.ier 
compilers  is  frequently  called  “register  allocation") 
the  difference  being  that  not  only  registers  are 
allocated,  but  memory  locations  as  well.  The 
entities  which  are  assigned  to  ! •:;.;iOns  (registers 
or  memory)  include  both  cc.ipiler-generated 
temporaries  and  user-defined  "local"  variables. 

The  output  of  this  phase  includes  that  of  DELAY 
plus  the  bindings. 

CODE  The  function  of  the  CODE  phase  is  to  produce 

locally  optimal  code  for  each  tree  node;  hence  its 
output  is  a representation  of  the  tcrget  machine 
language  (the  tree  is  discarded  at  this  point).  In 
some  cases  the  locally  optimal  code  is  completely 
determined  in  DELAY)  in  these  cases  the  action  of 
CODE  is  trivial.  In  many  cases,  however,  further 
analysis  is  required.  For  example,  it  is  CODE’S 
responsibility  to  determine  the  optimal  sequence 
of  shift  and  mask  instructions  to  move  an 
arbitrary  subfield  of  one  word  into  an  arbitrary 
position  of  another. 

FINAL  FINAL  has  two  responsibilities.  The  simpler  of 

these  is  to  prepare  the  final  listing  and  object 
code  files.  The  more  interesting  responsibility  is 
a collection  of  relatively  ad  hoc  "peephole" 
optimizations.  These  optimizations  are  performed 
by  examining  the  actual  code  produced  by  CODE 
and  eliminating  inefficiencies  which  CODE  was 
unable  to  detect.  For  example,  FINAL  will  replace 
a jump  instruction  which  transfers  to  another 
jump  by  one  which  transfers  directly  to  the 
ultimate  destination.  It  will  also  remove 
unreachable  code,  reverse  the  sense  of  certain 
tests,  combine  some  instructions,  etc. 

As  can  be  seen  from  the  above,  the  phases  operate  independently  of  each 
other  with  respect  to  each  subroutine.  Thus  while  one  phase  is  working  with  one 
subroutine  another  phase  can  be  compiling  a different  subroutine.  The  compiler  looks 
very  much  like  a pipeline. 
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III.B.2.  Application  of  tha  STEPPS  system  to  Blin/11 

A multiprocess  model  of  the  Bliss/11  compiler  was  examined  using  the  STEPPS 
system.  A protocol  of  the  use  of  the  system  for  this  application  is  presented  in 
Appendix  B.  The  issues  that  were  explored  concerning  the  multiprocess  decomposition 
are: 

1.  now  do  specific  alternate  multiprocess  decompositions  of  the  compiler 
affect  throughput?  Throughput  was  measured  in  terms  of  the  number  of 
routines^  processed  per  unit  time. 

2.  Does  the  performance  of  the  model  suggest  other  decompositions? 

3.  When  the  number  of  processors  is  restricted,  what  are  the  effects  of 
different  scheduling  algorithms? 

4.  What  are  the  relationships  among  the  number  of  processors  available,  the 
average  number  of  active  processes,  and  throughput? 

The  model  of  a multiprocess  Bliss/11  compiler  follows  the  same  general 
pipeline  structure  as  the  phases  of  the  original  compiler  [Wulf  75a].  Each  phase  is 
modeled  as  a server  with  an  exponentially  distributed  processing  rate. 

Measurements  of  the  operation  of  the  real  Bliss/11  compiler  were  taken;  nine 
programs  of  differing  complexity  were  compiled  by  an  instrumented  version  of  the 
actual  compiler.  The  total  time  spent  in  each  phase  was  determined  and  the 
corresponding  percentage  of  total  processing  time  was  computed.  These  data  are 
shown  in  Figure  111-10.  The  phases  are  grouped  slightly  differently  than  those 
discussed  earlier,  due  to  actual  Bliss/11  structu-al  properties;  LEX  is  separated  from 
SYNFLO,  and  TNBIND  combines  TLA,  RANK  and  PACK. 

The  processing  rates  of  the  STEPPS-modeled  processes  were  chosen  based  on 
the  percentage  of  total  processing  from  the  Bliss/11  measurements.  For  example,  the 
processing  rates  for  CODE  and  SYNFLO  were  chosen  to  be  .084  units  and  .216  units 


^The  unit  of  compilation  in  the  Bliss/11  compiler. 
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Phase 

Time 

Percent  of 

(seconds) 

Total 

LEX 

67.92943 

26.0  7 

SYNFLO 

56.38539 

21.6  7. 

DELAY 

9.64012 

3.7  7 

TNBIND 

2.78647 

10.7  7. 

CODE 

22.08524 

8.4  7 

FINAL 

77.17126 

29.6  7. 

Total 

261.07621 

100.0  7 

Figure  III-10.  Bliss/11  measured  data 


respectively.  The  LEX  process  was  considered  to  be  the  generating  process  which 
provided  elements  to  be  processed  at  an  exponential  rate  with  mean  .260  units. 
Figure  III- 11  6hows  the  set  of  commands  to  the  STEPPS  system  used  to  create  the 
model  (Appendix  A contains  a complete  description  of  the  STEPPS  commands). 


Model  BL1 1 

Density  expon  port  lex.oO  link  Is  mean  .26 

Density  expon  port  synflo.oO  link  sd  mean  .216 

Density  expon  port  delay.oO  link  dt  mean  .037 

Density  expon  port  tnbind.oO  link  te  mean  .122 

Density  expon  port  code.oO  link  cf  mean  .084 

Density  expon  port  final.oO  link  fr  mean  .296 

synflo.I20*-ls 

delay.I20«-sd 

tnbind.I20«-dt 

code.I20*-tc 

final.  I20«-cf 

synflo.oO  - 10:0;  120:1/10:1 

copy  delay.I20,  tnbind.I20,  code.I20,  final.I20.synflo.I20 
copy  delay.oO,  tnbind.oO,  code.oO,  final.oO:synflo.oO 
result.  iO*-fr 

schedule  noncompete  result 
attribute  tc,cf,dt,fr,ls,sd  Queue:100 


Figure  III- 11.  STEPPS  Bliss/11  model  commands 


A graph  representation  of  this  model  is  shown  in  Figure  III-12. 

The  first  set  of  experiments  consisted  of  simulating  the  model  with  one  to  six 
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LEX 
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SYNFLO 


44 


OELAY 


J TNB1NO 


44 


CODE 
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DT 


TC 


FINAL 

CF 


4 i RESULT 


FR 


Figure  111-12.  Bliss/11  graph  model 


processors  using  one  process  per  phase.  For  each  number  of  processors,  the  effects 
of  three  scheduling  algorithms  were  also  measured.  These  algorithms  were:  First-ln- 
First-Out  (FIFO),  Random,  and  Link  (select  the  process  with  the  largest  number  of 


waiting  messages).  These  algorithms  are  discussed  in  Chapter  V. 

The  results  of  these  experiments  are  shown  in  Figures  111-13,  111-14,  111-15,  HI- 
16,  and  111-17.  The  measurements  were  performed  on  700-900  messages 
(representing  routines)  passing  from  the  LEX  p;Ocess  through  the  FINAL  process.  The 
maximum  possible  throughput  rate  per  experiment  (i.e.,  simulation  execution)  is  the  rate 
at  which  routines  are  produced  by  the  LEX  process.  Thus  the  maximum  expected 
throughput  rate  is  the  reciprocal  of  the  processing  rate  of  LEX  for  each  simulation, 
4.00  routines  per  unit  time  when  the  expected  time  between  routines  is  .250  (1 


processor,  FIFO).  The  observed  throughput  rate  was  found  by  dividing  the  number  of 


routines  entering  RESULT  by  the  total  processing  time. 


Prcrs.  LEX  Rate  Thru  Rate  7.  Thru  Rate  Avg.  Active  Avg.  Waiting 


1 .254  0.96 

2 .272  1 78 

3 .279  2.74 

4 .252  3.40 

5 .272  3.37 

6 .259  3.28 


24.0  1.00  4.98 

48.4  2.00  3.28 

76.4  2.96  1.61 

85.6  3.33  0.44 

91.7  3.66  0.04 

88.3  3.57  0.00 


Figure  111-13.  Bliss/ll  Simulation  FIFO  Table 


The  measure  that  was  used  as  the  basis  for  comparing  performance  was  the 
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Prcrs,  LEX  Rate  Thru  Rate  7.  Thru  Rate  Avg.  Active 


Avg.Waiting 


LEX  Rate 


Figure  111-14.  Biiss/1 1 Simulation  LINK  Table 
Thru  Rate  7.  Thru  Rate  Avg.  Active 


Avg.Waiting 


1 

.242 

0.! 

2 

.241 

1/ 

3 

.273 

2: 

4 

.263 

3.: 

5 

.257 

3.5 

6 

.259 

3.‘ 

.91 

22.0 

1.00 

.96 

47.2 

2.00 

.78 

75.9 

2.94 

.36 

88.4 

3.50 

.56 

91.5 

3.62 

.50 

90.6 

3.64 

Figure  III- 15.  Biiss/1 1 Simulation  RANDOM  Table 

percent  of  maximum  throughput  rate.  This  measure  was  chosen  because  the  measured 
throughput  rates  varied  due  to  the  approximation  to  exponential  processing  rates.  For 
example,  four  processors  using  FIFO  scheduling  showed  a throughput  rate  of  3.40  out 
of  max  rate  of  1/.252  - 3.97  for  85.6  percent. 

Several  implications  concerning  this  multiprocess  model  were  apparent  from 
these  results.  First,  the  addition  of  more  processors  has  a major,  approximately  linear, 
effect  on  throughput  until  four  processors  are  used.  Addition  of  a fifth  processor  doas 
not  cause  a very  large  improvement  (about  867.  to  917).  Adding  a sixth  processor 
does  not  indicate  any  significant  difference.  Another  factor  is  that  the  different 
scheduling  algorithms  do  not  seem  to  significantly  affect  the  model’s  performance.  The 
average  number  of  active  procettet  (and  processors)  and  avenge  number  of  ready 
procet$e$  measures  also  indicate  that  Mter  four  processors  are  available  most  of  the 
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THRU 
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BLISS/11  PROCESSORS  SCHEDULED 


Figure  111-16.  Bliss/1 1 Percentage  Maximum  Throughput 
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required  processing  power  is  available.  This  helps  confirm  the  observation  that  the 
addition  of  more  processors  beyond  four  does  not  lead  to  as  major  a performance 
improvement  as  adding  one  processor  to  fewer  than  four  processors. 

The  next  set  of  experiments  included  multiple  copies  of  some  of  the  slower 
processes  as  part  of  the  model  as  an  alternative  to  the  simple  pipeline  structure.  The 
only  process  that  could  not  be  duplicated  was  the  LEX  process  since  part  of  its 
function  Is  recognizing  the  sequences  of  characters  as  delimiting  a routine  definition. f 
An  examination  of  the  data  indicated  that  there  were  three  major  bottlenecks.  The 
bottlenecks  were  identified  by  locating  links  between  processes  where  the  expected 
queue  length  was  large.  Figures  111-18,  111-19,  and  111-20  show  the  expected  queuo 
lengths  at  the  links  between  the  processes.  Naturally,  these  were  the  same  processes 
that  had  relatively  slow  processing  rates*  Three  alternate  structures  were  examined: 

A.  2 FINALS  and  2 SYNFLOsj 

B.  3 FINALS  and  2 SYNFLOs; 

C.  3 FINALS,  2 SYNFLOs  and  2 TNBINDs. 

Prcrs.  LS  SD  DT  TC  CF 

1 9.194  0.000  0.000  0.000  0.000 

2 8.403  5.148  7.172  8.107  9.354 

3 2.108  0.010  0.263  1.505  6.401 

4 5.682  6.648  8.817  9.048  9.643 

5 2.765  1.770  2.556  3.309  6.674 

6 3.596  2.100  3.432  5.350  8.732 

Figure  III-18.  Bliss/11  Simulation  FIFO  Queue  Lengths 

These  structures  were  run  with  1,  5,  8 and  all  possible  processors.  Although 


tThi$  can  be  done  by  Begin-End  counts. 

*The  large  queue  that  formed  before  the  Code  phase  was  due  to  Code  being  unable  to 
send  results  to  Final  and  thus  had  to  wait  before  processing  new  routines. 
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Prcrs. 

LS 

SD 

DT 

TC 

CF 

1 

0.410 

0.616 

0.000 

0.219 

0.001 

2 

7.923 

0.087 

0.987 

5.364 

9.111 

3 

4.139 

0.078 

0.713 

4.533 

8.892 

4 

3.455 

1.136 

4.623 

6.972 

9.248 

5 

4.266 

3.268 

5.757 

7.018 

8.945 

6 

5.903 

6.204 

8.404 

8.999 

9.836 

Figure  III- 

19.  Bliss/11  Simulation  LIN 

Prcrs. 

LS 

SD 

DT 

TC 

CF 

1 

8.461 

4.329 

1.796 

0.623 

0.717 

2 

7.928 

0.404 

0.864 

1.362 

7.925 

3 

4.561 

0.047 

0.975 

5.494 

f.t  \ 

4 

3.355 

2.727 

5.326 

7.749 

9.«3 

5 

3.419 

1.488 

3.306 

5.738 

9.176 

6 

2.976 

3.762 

7.766 

8.661 

9.472 

Figure  111-20.  Bliss/11  Simulation  RANDOM  Queue  Lengths 


the  simulations  were  run  using  all  three  scheduling  algorithms,  there  was  not  much 
difference  in  performance  due  to  the  scheduling  algorithm  (less  than  one  per  cent). 
Thus  Figures  HI-21,  111-22  and  III-23  show  the  results  using  eithrr  FIFO  or  LINK 
scheduling.  Figures  III-22  and  III-23  also  show  graphs  of  the  FIFO  results  without 
using  multiple  copies  of  phases.  As  the  graphs  show,  each  of  the  multiple  process  per 
phase  models  performs  better  than  the  single  process  per  phase  model,  given  enough 
processors.  Structure  C,  above,  performed  the  best  among  them. 

The  difference  among  the  structures  was  not  very  large,  viz.  about  57.  of  the 
maximum  rate.  Although  there  is  improvement  using  the  multi-copy  structures,  the 
improvement  over  the  single  process  per  phase  does  nut  appear  to  warrant  such 
structure.  Instead,  the  bottleneck  appears  to  be  the  LEX  process  which  is  inherently 
sequential.  This  observation  suggested  another  experiment  to  determine  the  effects  of 
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Decom- 

position 


Bll  (A) 


Bll  (B) 


Bll  (C) 


Figure 


Prcrs. 

LEX 

Rate 

Avg. 

Active 

Avg. 

Ready 

Thru 

Rate 

7.  Max 
Thru  Rate 

1 

.253 

1.00 

4.78 

0.98 

24.8 

3 

.251 

2.88 

2.23 

2.87 

72.0 

5 

.272 

3.68 

2.28 

3.59 

96.8 

8 

.267 

3.79 

0.00 

3.70 

98.8 

1 

.276 

1.00 

4.79 

0.98 

27.0 

3 

.276 

2.82 

2.04 

2.77 

76.4 

5 

.261 

3.71 

0.38 

3.65 

95.3 

6 

.255 

3.99 

0.00 

3.89 

99.2 

8 

.253 

3.94 

0.00 

3.93 

99.4 

9 

.278 

3.64 

0.00 

3.58 

99.5 

1 

.288 

1.00 

5.43 

0.92 

26.5 

3 

.263 

2.81 

2.25 

2.76 

72.6 

5 

.274 

3.55 

0.41 

3.46 

94.8 

8 

.259 

3.86 

0.01 

3.85 

99.7 

11 

.244 

4.03 

0.00 

4.07 

98.3 

111-21.  Table  of 

Results  of  Multi -copy  Bliss/ 11  Phase  Models 

further  decomposing  LEX  into  a pipeline  of  phases:  FILE,  ATOM,  and  NT|SEARCH.  The 
goal  was  to  increase  the  rate  at  which  messages  reached  the  SYNFLO  phase.  The 
‘ results  of  this  set  of  experiments  are  shown  in  the  table  of  Figure  III-24.  It  can  be 
seen  that  the  rate  at  which  messages  queued  up  to  the  SYNFLO  phase  decreased  from 
.26  to  .18  for  an  increase  of  447.  due  to  the  further  decomposition  of  the  LEX  phase. 

Other  process  structures  may  also  be  studied  using  the  STEPPS  system. 
Current  research  into  the  phases  of  Bliss/11  indicates  that  two  of  the  phases  could  be 
restructured.  The  DELAY  phase  [Johnsson  76]  could  perform  more  complex  operations 
(and  would  be  slower).  The  FINAL  phase*  could  also  be  altered  or  decomposed  even 
further  into  smaller  independent  processes. 

Since  the  data  presented  represent  about  fifty  separate  model  simulations,  the 
Bliss/11  experiments  were  executed  over  several  weeks.  Each  simulation  required 


*S.  Hobbs,  current  research. 
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FILE 

NS  Send 

Avg. 

Avg. 

Thru 

7 Max 

7.  Max 

Prcrs 

Rate 

Rate 

Active 

Ready 

Rate 

of  FILE 

"LEX" 

3 

.119 

.29 

2.96 

2.97 

2.38 

27.13 

69.02 

5 

.120 

.20 

4.41 

0.79 

3.20 

38.40 

64.00 

7 

.126 

.18 

4.92 

0.02 

3.52 

44.35 

63.36 

8 

.121 

.18 

4.85 

0.00 

3.29 

39.81 

59.22 

Figure  111-24.  LEX  Decomposition  Results 
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execution  time.  This  amount  of  time  was  not  particularly  large  since  It  is  about  the 


same  amount  of  time  that  was  required  to  obtain  the  Bliss/11  data  originally. 

As  detailed  in  Appendix  C,  these  simulation  experiments  were  statistically 
validated.  Based  on  trial  runs,  message  traffic  flows  and  simulation  run  times  were 
determined  for  eliminating  initial  condition  bias  in  the  subsequent  experiments.  Since 


there  were  many  different  simulation  experiments,  one  was  chosen  for  developing 
statistical  confidence  intervals.  Thus,  for  the  experiment  using  six  processors  and  FIFO 
scheduling,  the  907.  confidence  intervals  computed  were:  LEX  Computing  Time, 
[.245, .264];  Percent  Thru,  [84.6,88.5];  and  Thru  Rate,  [3.28,3.57].  Comparing  these 
intervals  with  the  results  shown  in  Figure  111-13,  it  can  be  seen  that  each  of  the  values 


falls  within  these  respective  confidence  intervals  (i.e,  2.59,  88.3,  3.28). 

These  Bliss/11  experimental  results  should  have  several  implications  to  system 
designers  of  a multiprocess  Bliss/11  compiler.  Foremost  is  the  conclusion  that  there 
should  be  an  increase  in  processing  throughput  of  about  four  times  over  a sequential 
compiler.  This  estimated  increase  is  significant  in  that  it  demonstrates  both  potential 
benefits  and  potential  limitations  in  developing  a (possibly)  complex  multiprocess 
Bliss/11  compiler.  Given  that  the  designer  chooses  to  develop  the  multiprocess 
compiler,  it  can  be  observed  that  the  compiler  should  not  necessarily  be  designed  to 
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dedicate  a processor  to  each  process.  The  simulated  result  shows  that  there  Is  an 
approximate  linear  increase  in  throughput  when  using  a small  number  ov  processors, 
but  after  about  two  thirds  of  the  number  of  potential  processors  are  used  the 
maximum  throughput  rate  is  almost  achieved.  The  bottleneck  was  shown  to  be  the 
lexical  analysis  phase  of  the  compilation  process.  Finally,  it  was  shown  that  simple 
scheduling  disciplines  (FIFO  and  most  messages  waiting)  did  not  affect  potential 
throughput  ate  more  than  a random  prociss  scheduling  technique.  Thus  these  simple 
experiments  using  the  STEPPS  model  and  STEPPS  system  should  provide  information 
that  would  affoct  the  design  of  a multiprocess  Bliss/11  compiler. 

III.C.  Using  STEPPS  during  system  construction  and  tuning:  Hearsay  II 

The  Hearsay  II  speech  understanding  system  (HSII)  [Fennell  75a,  75b,  Lesser 
74]  has  been  designed  to  utilize  a variety  of  analysis  sources  to  solve  the  problem  of 
understanding  human  speech  for  performance  of  a task  [Newell  71].  The  problem  ha=» 
been  functionally  decomposed  so  that  individual  subparts  of  the  problem  solution  can 
be  performed  concurrently,  with  each  contributing  to  the  speech  understanding  task. 

The  Hearsay  II  system  is  being  implemented  on  both  a uniprocessor,  a DEC 
PDP-10,  and  in  a similar  form  on  a multiprocessor,  the  CMU  C.mmp.  The  uniprocessor 
implementation  is  structured  as  if  it  were  being  implemented  on  a multiprocessor,  with 
a scheduler  deciding  on  the  acfual  order  of  processing.  The  C.mmp  implementation 
contains  some  design  alternatives  chosen  to  reflect  restrictions  due  to  the  Hydra 
operating  system  [Levin  75,  Wulf  74],  Some  implementation  Issues  8re  common  for 
both  machines  since  the  systems  are  based  on  the  same  design. 


HI  C Using  STEPPS  during  system  construction  and  tuning:  Hearsay  11 


111-29 


Ill.C.l.  Overview  of  Hearsay  II  system  organization 


The  following  is  a description  of  the  organization  of  the  HS11  system  [Fennell 
. end  Lesser  75]+ 

The  Hearsay  11  speech-understanding  system 
(HSU)  (Lesser,  et  al.  1974;  Fennell,  1975;  and  Erman  and 
Lesser,  1975)  currently  under  development  at  Carnegie- 
Metlon  University  represents  a problem-solving  organization 
that  can  effectively  exploit  a multiprocessor  system.  HSU  has 
been  designed  as  an  Al  system  organization  suitable  for 
expressing  knowledge-bated  problem-tolving  itrateglet  in 
which  appropriately  organized  subject-matter  knowledge  may 
be  represented  as  knowledge  tourcet  capable  of  contributing 
their  knowledge  in  a parallel  data-directed  fashion.  A 
knowledge  tource  may  be  described  as  an  agent  that 
embodies  the  knowledge  of  a particular  aspect  of  a problem 
domain  and  is  useful  in  solving  a problem  from  that  domain  by 
performing  actions  based  upon  its  knowledge  so  as  to  further 
the  progress  of  the  overall  solution.  It  Is  felt  that  the 
knowledge  source  is  an  appropriate  unit  for  use  in  the 
decomposition  of  a knowledge-intensive  task  domain. 

Knowledge  sources,  being  suitably  organized  capsules  of 
subject-matter  knowledge,  may  be  independently  formulated 
as  various  pieces  of  the  knowledge  relevant  to  a task  domain 
become  crystallized.  The  HSII  system  organization  allows 
these  various  Independent  and  diverse  sources  of  knowledge 
to  be  specified  and  their  interactions  coordinated  so  they 
might  cooperate  with  one  another  (perhaps  asynchronously 
and  in  parallel)  to  effect  a problem  solution.  As  an  example 
of  the  decomposition  of  a trsk  domain  there  might  be  distinct 
knowledge  sources  to  deal  with  acoustic,  phonetic,  lexical, 
syntactic,  and  semantic  information. 

* * * 


...  A production  tyttem  is  a scheme  for  specifying  an 
information  processing  system  in  which  the  control  structure 
of  the  system  is  defined  by  operations  on  a set  of 
productioni  of  the  form  ’P’  -<  A’,  which  operate  from  and  on  a 
collection  of  data  structures.  represents  a logical 
antecedent,  called  a precondition,  which  may  or  may  not  be 
satisfied  by  the  information  encoded  within  the  dynamically 
current  s\?t  of  data  structures.  If  ’P’  is  found  to  be  satisfied 
by  some  csta  structure,  then  the  associated  action  ’A’  may  be 
executed,  which  presumably  will  have  some  altering  effect 
upon  the  data  base  such  that  some  other  (or  the  same) 


^Used  with  permission. 
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precondition  becomes  satisfied.  This  paradigm  for  sequencing 
of  the  actions  can  be  thought  of  as  a data-directed  control 
structure,  since  the  satisfaction  of  the  precondition  is 
dependent  upon  the  dynamic  state  of  the  data  structure. 
Productions  are  executed  as  long  as  their  antecedent 
preconditions  are  satisfied,  and  the  process  halts  either  when 
no  precondition  is  found  to  be  satisfied  or  when  an  action 
executes  a stop  operation  (thereby  signalling  problem 
solution  or  failure,  in  the  case  of  problem-solving  systems). 

* * * 


. . . The  HSII  system  organization,  which  can  be 
characterized  as  a "parallel"  production  system,  has  s 
centralized  data  base  which  represents  the  dynamic  problem 
solution  state.  This  data  base,  which  is  known  as  the 
blackboard,  is  a multidimensional  data  structure  which  is 
readable  and  writable  by  any  precondition  or  knowledge- 
source  process  (where  a knowledge -source  process  is  the 
embodiment  of  a production  action).  Preconditions  are 
procedurally  oriented  and  may  specify  arbitrarily  complex 
tests  to  be  performed  on  the  data  structure  in  order  to 
decide  precondition  satisfaction.  Preconditions  are 
themselves  data-directed  in  that  they  are  tested  for 
satisfaction  whenever  relevant  changes  occur  in  the  data 
base,  and  simultaneous  precondition  satisfaction  is  permitted. 
Testing  for  precondition  satisfaction  is  not  presumed  to  be  an 
instantaneous  or  even  an  indivisible  operation,  and  several 
such  precondition  tests  may  proceed  concurrently. 

* * * 

. . . The  basic  structure  and  components  of  the  HSII 
organization  may  be  depicted  as  shown  in  the  message 
transaction  diagram  of  Figure  111-25.  The  diagram  indicates 
the  paths  of  active  information  fiow  between  the  various 
components  of  the  problem-solving  system  as  solid  arrows; 
paths  indicating  control  activity  are  shown  as  broken  arrows. 
The  major  components  of  the  diagram  include  a passive  global 
data  structure  (the  blackboard ) which  contains  the  current 
state  of  the  problem  solution.  Access  to  the  blackboard  is 
conceptually  centralized  in  the  blackboard  handler  module,^ 
whose  primary  function  is  to  accept  and  honor  requests  from 


The  blackboard  handler  module  could  be  implemented  either  as  a 
procedure  which  is  called  as  a subroutine  from  precondition  and 
knowledge  source  processes,  or  as  a process  which  contains  a queue  o; 
requests  for  blackboard  access  and  modification  sent  by  precondition  and 
knowledge  source  processes.  In  the  implementation  discussed  in  the 
paper  (i.e.,  Fennell  and  Lesser  75),  the  blackboard  handler  module  is 
implemented  as  a subroutine. 
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the  active  processing  elements  to  read  and  write  parts  of  the 
blackboard.  The  active  processing  elements  which  pose  these 
data  access  requests  consist  of  knowledge- source  procettct 
and  their  associated  preconditions.  Preconditions  are 
activated  by  a blackbiard  monitoring  mechanism  which 
monitors  the  various  write-actions  of  the  blackboard  handler! 
whenever  an  event  occurs  which  is  of  interest  to  t particular 
precondition  process,  that  precondition  is  activated.  If  upon 
further  examination  of  the  blackboa-d,  the  precondition  finds 
itself  "satisfied,"  the  precondition  may  then  request  a process 
instantiation  of  its  associated  knowledge  source  to  be 
established,  passing  the  details  of  how  the  precondition  w$» 
satisfied  as  parameters  to  this  instantiation  of  the  knowledge 
source.  Once  instantiated,  the  knowledge -source  process  can 
respond  to  the  blackboard  data  condition  which  was  detected 
by  its  precondition,  possibly  requesting  further  modifications 
to  be  made  to  the  blackboard,  perhaps  thereby  triggering 
further  preconditions  to  respond  to  the  latest  modifications. 
This  particular  characterizatio  , of  the  HSII  organization,  while 
certainly  overly  simplified,  shows  the  data-driven  nature  of 
the  knowledge  source  activations  and  interactions. 


III.C.2.  STEPPS  model  of  Hearsay  II  organization 

The  STEPPS  model  was  used  to  represent  the  operation  of  the  individual 
processing  components  of  the  HSII  system,  the  precondition  (PC)  processes  and  the 
knowledge  source  (KS)  processes.  In  addition  the  data  base  (DQ)  blackboard  was 
modeled  as  a set  of  synchronization  locks  similar  to  these  presented  in  Section  III.A.5. 
In  some  cases  locks  cascaded,  i.e  i lock  operation  caused  performance  of  two  or 
more  other  locks.  The  details  of  the  STEkPS  HSII  models  are  shown  in  Appendix  B. 

Figure  III-26  shows  a detailed  description  of  the  PC  process  actions  and  Figure 
III-27  shows  the  corresponding  STEPPS  graphic  and  system  transition  matrix  notations. 
The  essential  common  actions  of  a PC  are  modeled:  wait  for  condition,  examine  DB, 
compute,  possibly  initiate  a KS,  and  repeat. 

Similarly,  Figure  III-28  shows  a detailed  description  of  the  KS  process  actions 
and  Figure  III-29  shows  the  corresponding  STEPPS  graphic  and  transition  matrix 
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Figure  III-26.  Description  of  Precondition  Process 
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Figure  111-27.  STEPPS  Precondition  Model 

notations.  The  essential  common  KS  process  actions  are  modeled:  wait  to  start, 

examine  data  base,  process,  and  possibly  after  the  data  base. 

It  can  be  seen  from  these  descriptions  that  there  are  relationships  between 
the  Precondition  processes  and  the  Knowledge  Source  processes.  These  are 
relationships  whereby  PC's  send  -n.ss.,.s  to  KS's.  In  STEPPS,  this  Is  represented  by: 
KS.U«-KSL1NK«-PC.05  I Connect  PC  to  KS  through  KSL1NK 
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Knowledge  Source 
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Figure  111-28.  Knowledge  Source  Process  Description 

The  model  has  been  designed  so  that  there  is  some  decision  process  which 
chooses  which  PC  will  next  receive  notice  to  start  processing.  This  decision  process, 
called  PCSELECTOR,  is  attached  to  the  port  11  of  each  precondition.  Figure  III-30 
shows  the  graphical  relation  between  PCSELECTOR  and  the  set  of  preconditions.  A 
possible  transition  matrix  for  PCSELECTOR  when  there  are  n preconditions  is: 
PCSELECT0R.0x-01:p1i02:p25  • • - On:pn  for  x-1, . , .,n 
The  PC  processes  and  KS  processes  interact  with  each  other  by  reading  and 
writing  the  data  base.  The  data  base  accessing  is  an  example  of  the  Reader/Writer 

problem  that  was  discussed  in  an  earlier  section. 

The  Hearsay  II  system  has  been  designed  to  allow  the  dynamic  creation  of  KS 
processes.  These  processes  perform  their  respective  operations  and  then  disappear. 
Since  the  STEPPS  model  was  not  designed  to  allow  for  this  facility,  it  must  be 
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Figure  III-29.  STEPPS  Knowledge  Source  Model 


Figure  IH-30.  PCSELECTOR  process 
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approximated.  The  method  is  to  allow  a fixed  number  of  instantiations  of  a single  KS 
to  act  as  a pool  of  KS’s.  These  KS’s  compute  in-parallel  since  different  copies  of  the 
KS  can  accept  messages  from  their  entry  link  (Figure  III-31).  Thu  model  performs  as  if 
there  were  some  maximum  number  of  KS’s  of  each  type  allowed.  When  a suitable 
number  of  copies  of  a KS  are  available  the  limit  will  not  affect  performance. 


Figure  III-31.  Set  of  identical  Knowledge  Sources 


III.C.3.  Performance  questions  pertaining  to  the  HSII  model 

The  model  of  HSII  emphasizes  implicit  interprocess  communication  via  data 
directed  processing.  This  communication  is  the  basis  for  interprocess  interference 
which  occurs  either  when  processes  are  blocked  when  attempting  to  perform  a data 
lock  or  when  a process  waits  for  the  occurrences  of  actions  of  another  process 
(modeled  as  waiting  for  a message). 

The  following  are  pertinent  questions  for  structuring  of  the  Hearsay  II  system: 

1.  How  much  of  the  data  base  is  locked  and  when? 

2.  What  is  the  expected  interference  due  to  the  locking? 

3.  How  do  various  locking  strategies  compare? 

4.  Should  a PC  start  up  a set  of  KS  instantiations  sequentially,  in  parallel  or 
in  groups? 

5.  How  many  processors  are  needed? 

6.  What  are  the  effects  of  alternate  scheduling  algorithms? 
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7.  How  cai  the  processing  load  be  balanced  among  available  processors  and 
with  respect  to  the  data  base? 

8.  Is  there  a particular  number  of  processes  that  should  be  dedicated  to  KS  s 
and  another  number  that  should  be  dedicated  to  PC  s? 

The  ultimate  goal  is  to  be  able  to  solve  the  speech  prob'om  In  the  least  amount 
of  real  time.  The  questions  relate  to  the  goal  in  that  they  provide  an  understanding  of 
those  places  where  Hearsay  II  is  performing  well  and  poorly  with  respect  to 
interprocess  activity. 

III.C.4.  Application  of  the  STEPPS  system  to  Hearsay  II 

The  STEPPS  system  was  used  to  analyze  a Hearsay  II  phenomenon  discovered 
by  Fennell  [Fennell  75a,  75b}  He  appended  a multiprocess  simulator  to  a version  of 
the  developing  HSII  system  and  measured  the  processing  performance  under  several 
multiprocessor  configurations.  One  of  the  parameters  of  interest  to  him  was  the  effect 
of  locking  on  the  the  throughput  of  the  multiprocessing  system.  Throughput  is 
important  to  the  speed  with  which  the  HSII  system  would  perform  the  speech 
understanding  task.  Measures  of  throughput  that  he  used  were: 

1.  The  average  number  of  active  processors,  and 

2.  The  average  number  of  inactive  processors. 

One  of  Fennell’s  results  was  that  when  locking  was  used,  to  insure  data 

integrity  and  to  prevent  deadlocks,  he  obtained  a measure  of  throughput  averaging 

4.16  processors  with  16  processors  available.  However  when  the  locking  structure  of 

the  simulation  was  turned  off,*  the  average  number  of  active  processors  was  found  to 

be  11.84.  Fennell  did  not  explain  this  phenomenon,  but  noted  that  the  locking 

interference  had  a significant  effect  on  effective  parallelism  [Fennell  75a,  75b]. 

Tjhe  removal  of  the  locking,  as  reported  by  V.  Lesser  of  the  HSII  researchers,  does 
not  affect  data  integrity  since  the  locking  used  in  Fennell’s  simulations  concerned 
independent  fields  of  nodes. 
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The  STEPPS  system  was  proposed  as  a tool  to  analyze  this  phenomenon.  The 
motivation  was  twofold.  First,  the  locking/no  locking  problem  indication  of  close  to 
threefold  processing  utilization  deterioration  was  important  enough  to  analyze. 
Second,  this  problem  appeared  to  be  a practical  application  of  some  of  the  STEPPS 
facilities^  A factor  that  added  to  the  appropriateness  of  the  STEPPS  model  was  that  it 
is  easy  to  model  a data  driven  organizational  structure,  like  HSI1.  One  issue  for 
investigation  was  whether  the  probabilistic  approach  to  modelling  interprocess 
communications  was  sufficiently  powerful  to  reproduce  the  phenomenon  found  using 
Fennell's  simulation.  If  successful,  the  STEPPS  model  could  be  modified  for 
representing  costly  HS11  system  modifications,  and  predictions  could  be  made  of  their 

effects  on  HSII  performance. 

A brief  discussion  of  a pertinent  part  Of  the  locking  algorithm  follows  (See 
[Fennell  75a]  for  complete  details).  The  data  base  consists  of  a set  of  nodes  arranged 
in  a two-dimensional  structure.  Along  one  dimension  are  9 categories  called  lexical 
levels.  The  second  dimension  represents  ulleronce  lime  and  is  divided  into  30  distinct 
units.  Thus  a node  exists  in  a lexical  level  at  a given  utterance  time.  Nodes  can  be 
grouped  into  lime  ragions  covering  all  nodes  on  a single  lexicon  level  occurring 
between  time  a and  time  b (a  S b).  Locks  can  be  performed  on  individual  nodes  or  on 

regions— locking  nil  nodes  within  the  regions. 

In  order  to  prevent  deadlocks,  locking  is  performed  in  a hierarchical  manner 
using  specified  conventions.  The  hierarchy  is  that  locks  occur  in  the  order:  by  i-sxical 
level  and  'hen  by  increasing  time.  Each  process  performs  all  of  its  locks,  performs 
some  processing,  and  then  releases  all  of  its  locks.  There  can  be  no  deadlocks  since 
all  required  data  nodes  must  be  available  before  any  processing  occurs  and  all  nodes 

*It  was  not  originally  recognized  that  some  limitations  of  the  STEPPS  system  would 
also  be  Identified.  This  will  be  discussed  later. 
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are  released  before  any  new  locks  are  performed.  In  addition,  when  two  processes 
attempt  to  lock  the  same  pair  of  nodes  (possibly  among  other  nodes  as  well),  they  can 
not  mutually  block  each  other  since  they  both  must  perform  their  locks  in  the  same 
order. 

An  additional  attribute  of  the  HSII  locking  convention  is  that  a process 
maintains  a lock  on  a node  until  it  releases  all  of  its  nodes.  This  means  that  if  a 
process  locks  node  A but  is  blocked  from  locking  node  B,  it  waits  for  the  release  of 
node  B before  continuing  and  maintains  Its  lock  on  node  A while  being  blocked.  This 
‘ method  guarantees  that  each  process  will  eventually  complete  its  required  processing, 
but  the  method  can  cause  a third  process  to  be  blocked  unnecessarily  If  It  only  tries  to 
lock  node  A. 

III.C.5.  The  STEPPS  simulation  of  the  locking  problem 

An  analysis  of  the  Hearsay  II  knowledge  sources  and  preconditions  was 
performed  to  determine  the  parts  of  the  blackboard  examined  by  each  process  type. 
By  executing  the  HSII  prototype  system  in  a sequential  mode  with  data  collection 
features  turned  on,  members  of  the  HSII  development  team^  generated  data  that  was 
analyzed  to  determine  proper  probabilities  and  compute  ;^n  tines  u^cd  In  the  STEPPS 
model  of  HSII. 

Due  to  the  STEPPS  sys.';:;  overhead,  ine  complete  set  tf  pordoifl  iockin*. 
structures  could  not  be  mocV'io.  Thus  th'  STEPPS  modal  of  HSi\  *op- ox:m«:'sd  *vt 
locking  structure.  Fot  me  simulation  o'  HSII  it  was  determined  tit*  locking  occurreu  in 
only  23  ways  witn  respect  to  lexicon  le»..*.  Figure  ill-32  shows  the  matrix 
representing  these  locks  and  which  processes  performed  the  locks.  Each  process 

^Special  appreciation  is  ackne  wl  ’ Jged  to  V.  Lr sser,  R.  Fennell,  and  Ci.  G>,! 
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could  choose  from  among  its  possible  locks  (as  shown  in  the  table)  uniformly  as  the 
current  locking  set  for  the  process. 


Lock  Lexicon 
No.  Levels  Locked 

Lock 

No. 

Lexicon 
Levels  Locked 

1. 

WORD  + WRDSURN 

13. 

PHON  4 PSEG 

2. 

WORD  + WRDSURN  + SURN 

14. 

PSEG  4 SEG 

3. 

WORD  + SURN  + PHON  4 MXN 

15. 

SHDSENT 

4. 

WRDSURN  + SURN  + PHON 

16. 

SHDWORD 

5. 

WRDSURN  + SURN 

17. 

WORD 

6. 

SURN  + PHON  + MXN  + PSEG 

18. 

WRDSURN 

7. 

SURN  + PHON  + MXN 

19. 

SURN 

8. 

SURN  + PHON 

20. 

PHON 

9. 

PHON  4 MXN  4 PSEG 

21. 

MXN 

10. 

PHON  4 MXN 

22. 

PSEG 

11. 

MXN  4 PSEG  4 SEG 

23. 

SEG 

12. 

MXN  4 PSEG 
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Figure  111-32.  Hearsay  II  Locking  Structure  Matrix 
The  thrust  of  the  simulation  experiment  was  to  reproduce  Fennell’s  results 


using  a probabilistic  model.  Appendix  B contains  definitions  of  the  probabilities  used 
for  the  simulation.  The  first  question  of  interest  was  how  the  simulation  performed 
with  locking  vs.  without  locking. 
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The  Individual  time  divisions  for  locks  also  contribute  to  locking  Interference.  A 
second  Interesting  question  was  how  the  region  sizes  affected  simulated  interference. 
The  STEPPS  system  posed  an  overhead  limitation  on  what  could  be  modeled  and  so 
hindered  answering  this  question.  Specifically,  it  was  not  possible  to  represent  locking 
In  all  of  the  30  possible  divisions  (4680  possible  regions).  Instead  each  lexicon  level 
was  considered  as  a single  region  and  decomposed  Into  subregions  in  successive 
experiments  until  the  overhead  of  running  the  STEPPS  system  overwhelmed  the 

f 

computer. ' 

The  parameters  that  could  easily  be  altered  for  the  system  simulations  were: 

the  existence  of  locking, 

the  number  of  subregions  for  each  region, 

the  number  of  processors  available,  and 

the  probabilities  that  the  processes  performed  their  locks. 

The  region  locks  for  each  process  were  formed  by  examining  the  program 
structures  for  each  of  the  modeled  processes.  The  probabilities  used  by  a process  to 
choose  locking  structures  were  assigned  uniformly  over  the  possible  locks.  The  times 
between  locks  and  the  time  for  a lock  to  take  place  were  taken  from  the  HSII  system 
data. 

Several  models  of  the  system  were  simulated  and  representative  results  are 
shown  in  Figure  III-33.  The  results  demonstrate  that  with  no  process  interference 
there  can  be  12.26  processors  active  on  the  average.  This  corresponds  to  the  results 
found  by  Fennell’s  simulation  of  the  entire  HSII  system.  The  second  set  of  results 
(with  locking)  shows  that  when  the  region  locking  interference  is  introduced  there  is  a 
dramatic  decrease  in  parallel  processing.  As  the  regions  were  further  decomposed, 
parallel  processing  did  not  substantially  change. 


*We  ran  out  of  memory  at  200,000  words  on  the  PDP-10. 
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Locking  Strategy  Avg.  Active 

No  locking  interference  12.26 

With  locking  3.11 

Subregions  MXN{2),  PSEG<2)  3.06 

Subregions  MXN{2),  PSEG(2),  PH0N(2)  3.27 
Subregions  MXN(2),  PSEG{3),  PHON<2)  3 1 1 


Subregions  Total  Locks 
9 23 

9 23 

11  53 

11  75 

13  85 


Figure  111-33.  Hearsay  II  Representative  Results 


As  discussed  in  Appendix  C,  the  statistical  validation  of  these  results,  based  on 
the  elimination  of  initial  condition  bias,  was  accomplished  by  performirg  trial  runs  of 
the  Hearsay  II  model  to  deterime  subsequent  simulation  experiment  run  times. 
Confidence  intervals  were  not  determined  for  the  statistics  presented  since 
accumulated  statistics  (i.e.,  average  active  processors)  requires  multiple  simulations 
[Gordon  69]  which  were  felt  to  be  too  expensive.  Moreover,  the  STEPPS  Hearsay  II 
simulation  results  were  correspondences  to  Fennell's  simulation  experiments,  which 
were  also  not  validated  [Fennell  75a], 

The  STEPPS  simulation  results  demonstrate  that  the  probabilistic  approach  can 
be  used  to  model  the  Hearsay  II  multiprocess  communication  structure.  Both  the 
Fennell  and  the  STEPPS  simulations  indicated  about  a threefold  decrease  in  a measure 
of  processing  throughput  due  to  locking.  In  addition,  the  relatively  simple  STEPPS 
model  indicated  that  the  granular  locking  structure  used  by  Hearsay  II  may  not  be 
necessary. 


III.C.6  Reflections  on  the  STEPPS  Hearsay  11  simulation 

The  STEPPS  system’s  use  as  a tool  for  examining  the  Hearsay  11  process 
structure  was  successful  in  that  STEPPS  adequaoly  represented  major  interprocess 
communication  dependencies  and  produced  results  reflecting  on  the  Hearsay  II  system 
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structure.  The  probabilistic  approach  applied  within  the  STEPPS  structure  and  the 
approximations  to  the  actual  implementation  were  sufficiently  powerful  to  reproduce 
Fennell’s  result  and  Indicate  an  area  for  HSII  system  modification.  Another  significant 
observation  was  that  the  deta  used  to  reproduce  the  Fennell  result  came  from  a 
sequential  operation  of  HSII  and  yet  yielded  appropriate  predictions  concerning  the 
multiprocess  HSII  system.  This  observation  implies  that  the  HSII  multiprocess  structure 
does  not  produce  a large  amount  of  interprocess  assistance  (or  interference)  over  the 
STEPPS  multiprocess  model  that  contains  no  direct  interprocess  assistance. 

Some  further  simulation  experiments  might  have  been  useful  for  studying 
Hearsay  II.  However,  during  the  STEPPS  simulations  the  Hearsay  II  system  process 
structure  was  altered.  These  modifications  included  the  replacement  of  several 
Precondition  and  Knowledge  Source  processes  with  new  versions  which  resulted  in  an 
increase  in  the  total  number  of  processes.  To  incorporate  the  Hearsay  modifications 
would  have  required  the  collection  and  analysis  of  data  from  Hearsay  and  the  creation 
of  a new  STEPPS  model.  The  cost  in  computer  time  and  analysis  effort  was  too  large 
during  the  period  that  the  simulations  were  performed.  Experiments  that  might  hsve 
been  useful  are: 

Restrict  the  number  of  available  processors  instead  of  using  the  maximum 
possible. 

Modify  the  process  structure  to  use  many  simple  Precondition  and 
Knowledge  Sources. 

Increase  the  number  of  subregion  locking  beyond  that  used. 

An  additional  limitation  to  performing  these  simulation  experiments  was  the 
STEPPS  system  itself,  since  prototype  limits  of  the  STEPPS  system  wero  reached  when 
the  Hearsay  II  simulation  mode1  exceeded  available  PDP-10  memory. 

Even  considering  the  previously  discussed  limitations,  the  STEPPS  system 
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application  to  Hearsay  II  was  significant.  First,  the  STEPPS  model  could  easily 
represent  the  non-trivial  HSII  communications  structure.  Part  of  this  ease  was  due  to 
the  HSII  data  directed  process  organization  of  interest  In  the  experiment  being  well 
suited  to  the  probabilistic  nature  of  STEPPS  processes,  The  application  demonstrated 
that  the  data  collected  during  a STEPPS  simulation1  was  sufficient  to  provide  the 
required  results.*  Finally,  the  STEPPS  system  could  really  aid  the  HSII  systems 
developers  in  tuning  their  system  by  providing  a relatively  simple  framework  to 
examine  the  consequences  of  parameter  changes  (e.g.  probabilities  and  timing)  in 
addition  to  structural  changes. 


T$ee  Chapter  V for  details  on  simulation  data  collection  and  parameters. 
*Thi$  can  also  be  stated  for  the  Bliss/11  application. 


Chapter  IV 

Analysis  of  a STEPPS  Model 


£ STEPPS  model  of  a program  can  be  analyzed  to  predict  some  of  the 
program’?  performance  properties.  Unless  a model  is  analyzed  and  certified  as  safe,  a 
program  that  is  constructed,  based  on  the  model,  may  be  useless.  It  Is  sometimes 
valuable  to  exploit  the  similarity  of  the  STCPPS  model  to  Known  models  for  application 

of  known  analysis  techniques;  thus  we  begin  with  u review  of  these  models  and 
techniques. 

IV.A.  Markov  and  semi-Markov  processes 

The  model  of  a process  described  in  Chapters  I and  II  Is  essentially  a 
description  of  a semi-Markov  process  [Howard  71  vol.  1 & 2}  A discrete-time  Markov 
process  is  a probabilistic  system  composed  of  a set  of  states,  a designated  current 
state,  and  a probabilistic  rule  for  changing  between  states.  The  basic  rule  for  a 
Markov  process  is  that  the  probability  of  a transition  between  the  current  state  and 
any  successor  state  is  independent  of  any  past  history.  Let  be  the  set  of 

successive  events  and  let  the  finite  set  be  the  possible  state  values f.  Then 

the  Markov  assumption  Is  formally: 

^n+l  " *k  | Ef  ■ Xj , < ■ 1 n)  - P(En+j  - Xk  | En  - X:  ). 

1 Jn 

The  probability  that  the  next  event,  En+1,  is  a particular  state,  Xk,  Is  only  dependent 
on  the  last  event  Xj^.  When  finite  state  processes  are  studied,  the  probabilities  are 

TIn  general  the  state  values  could  be  an  Infinite  set,  but  this  research  Is  only 
concerned  with  finite  state  processes. 
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sometimes  chosen  to  approximate  known  distributions  to  facilitate  analysis  In  all 
cases,  the  sum  of  the  probabilities  of  transferring  from  a particular  state  to  the  set  of 
next  possibilities  mu?'  be  1. 

A Markov  process  may  be  composed  of  chains  of  states.  A chain  is  a set  of 
states  such  that  once  the  process  enters  one  of  the  states  of  the  set  the  only  other 
states  that  the  process  can  enter  are  in  that  set.  In  general,  a process  may  have  more 
than  one  chain  and  whichever  chain  is  entered  first  determines  how  the  process  will 
eventually  perform.  The  analysis  and  operation  of  a process  with  more  than  one  chain 
is  dependent  on  the  process’s  initial  state.  A process  with  only  one  chain  is  called  a 
monodesmic  procett. 

For  a monodesmic  Markov  process  It  Is  still  possible  that  some  states  do  not 
recur.  This  happens  If  the  process  can  ever  reach  a state  such  that  the  probability  of 
ever  reaching  some  states  is  zero.  States  that  can  not  recur  in  steady  state*  are 
called  transient  states.  Informally,  a transient  state  is  a state  of  a process  that  can 
only  be  entered  between  an  initial  state  and  a chain. 


Example  IV. A- 1 

Figure  IV- 1 (a)  shows  the  transition  matrix  of  a Markov  process  with 
two  chains.  The  states  of  the  process  are  w,  x,  y,  and  z.  If  the  process 
is  initially  in  either  state  w or  x then  the  only  states  that  it  can  ever 
enter  are  w and  x.  However  if  the  process  is  Initially  in  either  state  y 
or  z then  it  can  only  enter  states  y or  z.  Thus  the  process  has  two 
chains.  No  states  are  considered  to  be  transient  since  all  of  the  states 
are  in  some  chain. 

Figure  IV-1  (b)  shows  the  transition  matrix  of  a monodesmic  process 
having  two  transient  states.  The  states  of  the  process  are  a,  b,  c,  and 
d.  The  chain  is  composed  of  states  c and  d since  once  they  are  entered 
no  state  other  than  either  of  them  may  be  entered.  In  addition  states  a 
and  b do  not  form  a chain  since  the  process  may  eventually  enter  the  c 
- d chain  from  a and  b.  If  either  a or  b is  an  initial  state  they  may 
recur  many  times,  but  eventually  the  chain  will  be  entered  and  then  it 
will  be  impossible  to  enter  either  of  them  again. 

* Steady  state  is  defined  to  be  the  operation  of  the  process  after  some  suitably  large 

number  of  transitions. 
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(a)  Two  chains:  (w,x)  (y,z) 
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(b)  Transient  States:  a and  b 

Figure  IV- 1.  Markov  Processes 

Markov  processes  have  been  studied  in  order  to  solve  problems  such  as: 

What  is  the  expected  number  of  transitions  before  entering  state  ST 

What  is  the  probability  of  entering  state  S from  state  T:  (1)  in  m 
transitions?  (2)  in  m or  fewer  transitions?  (3)  ever? 

In  steady  state,  what  is  the  probability  of  entering  state  S on  the  next 
transition? 

The  last  question  points  out  one  example  where  steady  state  activity  is  considered 
important.  For  monodesmic  processes  the  initial  state  Is  unimportant,  but  the  activity 
of  processes  with  multiple  chains  is  strongly  dependent  on  the  initial  state  since  as 
shown  In  Example  1V.A-1  a process  can  behave  quite  differently  In  steady  state 
depending  on  how  it  was  initialized.  For  this  reason  most  models  using  Markov 

processes  are  monodesmic. 

This  research  is  also  concerned  with  the  stead',  state  properties  of  e 
multiprocessing  program.  Transient  states  create  difficulties  In  analyzing  data  flow  in 
the  steady  state  of  a multiprogramming  model  because  It  Is  possible  that  a process  will 
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never  reenter  a transient  state.  The  STEPPS  model  is  restricted  to  disallow  processes 
with  multiple  chains  and  transient  states  because  they  do  not  contribute  to  the  steady 
state  of  a process.  The  STEPPS  system  is  able  to  analyze  a process  and  determine 
whether  these  restrictions  have  been  met.  The  algorithms  for  performing  this  analysis 
are  discussed  later  in  this  chapter. 

A mini- M arkov  procett  is  a generalization  of  the  Markov  process  model.  In  a 
Markov  model,  one  unit  of  time  elapses  between  successive  transitions  in  all  cases.  In 
the  semi-Markov  model,  the  time  taken  between  successive  transitions  depends  on  the 
particular  transition.  In  the  model’s  most  general  form,  the  time  taken  between  any 
two  successive  states  can  be  a random  variable;  in  the  STEPPS  model  this  serves  no 
useful  purpose,  so  the  time  taken  between  any  two  particular  transitions  is  a constant 
depending  only  on  the  two  states.  In  fact,  the  real  time  between  transitions  in  a 
STEPPS  model  is  usually  not  completely  predictable  since  a process  may  be  forced  to 
wait  as  discussed  in  Chapters  I and  II. 

Some  problems  that  have  been  studied  using  the  semi-Markov  process  models 

ar^: 

What  is  the  expected  process  time  between  entering  state  S and  entering  state 

T? 

What  is  the  expected  process  time  between  recurrences  of  state  S? 

In  steady  state,  what  is  the  expected  percent  of  time  spent  in  state  S? 

Again,  the  last  question  is  the  most  interesting  one  for  the  STEPPS  model. 
There  is  not  always  an  accurate  result  for  a STEPPS  model  because  processes  in  the 
STEPPS  model  are  not  semi-Markov  due  to  the  essentially  unpredictable*  wait  time. 
However  an  estimate  of  the  type  of  activity  that  a process  will  be  performing  when  it 
is  executing  is  'till  a useful  result. 

*The  wait  time  is  unpredictable  for  a given  process  when  considering  the  process 
independently  of  the  entire  model. 
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The  theory  teiis  us  that  It  is  possible  to  predict  the  steady  state  probabilities 
of  which  state  will  be  entered  next,  not  knowing  the  present  state.  This  means  that  it 
is  possible  to  create  a representative  transition  matrix  such  that  each  row  is  the  same, 
l.e.  the  choice  functions  are  ail  the  same  when  the  most  recent  state  Is  unknown. 
These  probabilities  also  refiect  the  probabiiity  of  being  in  each  of  the  stutes  after  a 
large  number  of  transitions. 

The  steady  state  probabilities  can  be  determined  analytically  by  soiving  a set 
of  n+1  linear  equations  in  n unknowns.  Let  ST(,  5-1,  . . . , n be  the  steady  state 
probabilities  of  the  process  and  let  py  be  the  probabiiity  of  entering  state  j from 
state  I In  one  transition.  The  equations  to  be  solved  are: 

ST  j - Pl|j  * STi  ♦ . . . + Pn|i  • STn  for  i - 1 n 

1 ■ STj  + ST2  + . . • + STn 

The  first  n equations  are  redundant,  so  the  solution  requires  replacing  one  of 
the  first  n equations  with  the  last  equation.  The  system  of  equations  will  be  solvable 
since  the  matrix  describes  a monodesmlc  process  with  no  transient  states^Howard  71 
vol.  1}  Otherwise  the  equations  do  not  have  a unique  solution. 

The  analysis  that  has  just  been  described  is  one  of  the  Markov  theoretical 
analytic  techniques  that  can  be  applied  to  the  processes  of  a STEPPS  model.  The  fact 
that  the  STEPPS  model  processes  are  similar  to  semi-Markov  processes  is  only  useful 
if  a system  designer  wants  to  analyze  components  of  a STEPPS  model  In  this  way.  In 
most  cases,  Markov  and  semi-Markov  tnaiysis  of  STEPPS  processes  Is  of  limited 
usefulness  since  the  STEPPS  processes  are  oniy  components  of  a larger  model  and  the 
transition  matrices  do  not  entirely  reflect  the  operation  of  a process. 

In  order  to  represent  analytically  an  entire  STEPPS  model,  aii  possible  states 


^This  is  guaranteed  by  the  STEPPS  system. 
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(In  the  Markov  process  sense,  rather  than  STEPPS)  must  be  included  in  the  analytic 
description.  Not  only  must  every  STEPPS  state  be  included  as  analytic  states,  but  also 
analytic  states  must  be  introduced  to  represent  the  operations  of  the  STEPPS  links. 
The  effect  is  the  creation  of  a matrix  representing  at  least  N squarea  states  (where  N 
is  the  sum  of  the  number  of  STEPPS  states  in  each  STEPPS  process).  Not  only  is  this 
model  complex,  it  requires  the  introduction  of  probabilities  (and  associated  times)  for 
some  new,  potential  Markov  state  changes. 
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As  noted  in  Chapter  I,  in  order  for  a STEPPS  model  to  be  useful  it  must  meet 
certain  restrictions  and  be  designated  as  a well-formed  model.  Earlier  in  this  chapter 
it  has  been  pointed  out  that  each  process  in  a STEPPS  model  must  be  monodesmic  and 
have  no  transient  states  (termed  well-formed  proven).  An  additional  restriction 
guarantees  that  a model  represents  a data  flow  which  can  be  simulated  and  which  can 
reach  steady  state  if  simulated  for  a sufficient  period  of  time.  Hence  other  restrictions 
to  the  model  (termed  well-formed  graph)  are  that  all  links  must  be  attached  to  both 
input  and  output  ports,  that  all  ports  be  attached  to  links,  and  that  the  graph  be 
connected.  If  these  restrictions  were  not  imposed  then  some  process  would  eventually 
request  messages  from  an  empty  link  or  try  to  send  messages  to  a link  whose  message 
limit  has  been  reached. 

IV.B. I . Monodeamic  and  transient  state  well-formed  criteria 

Let  the  N states  of  a props'  be  identified  by  the  integers  1 to  N.  Let  the 
probability  of  state  j succeeding  state  i be  py,  the  entry  in  an  N by  N transition  matrix 


P. 
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In  order  to  test  whether  a process  is  monodesmic  and  has  no  transient  states  it 
is  sufficient  to  determine  whether  the  probability  of  each  state  transferring  to  each 
other  state  in  N or  fewer  transitions  is  greater  than  zero.  The  first  step  is  to  form  a 
transition  rotation  matrix,  C,  representing  a relation  between  states,  defined  by  Cy  r 
0 if  Pj  j - 0;  and  1 otherwise.  The  next  step  is  to  form  the  transitive  closure  of  the  C 
matrix,  which  describes  whether  there  exists  some  succession  of  connections  between 
any  two  states.  If  the  closure  of  C is  all  ones  then  every  state  is  able  to  transfer  to 
every  other  state  and  so  the  corresponding  process  is  monodesmic  and  has  no 
transient  states. 

There  are  several  algorithms  for  forming  the  transitive  closure  of  a relation. 
One  method  to  form  the  closure,  as  shown  by  Prosser  [Prosser  59],  starts  by  forming 
Boolean  powers  of  the  matrix  to  show  whether  a transition  can  occur  in  two  or  more 
transitions.  The  i,j  term  of  the  Boolean  square  of  a maVix  is  the  Boolean  expression 
(logical  sum): 

<c2>i,j  ■ ZNk-l  Ci,kChij 

The  i,j  term  is  equal  to  1 if  and  only  if  there  is  some  k such  that  Cj  ^ - Cyj  ■ 1. 
Similarly  if  the  N-th  power  of  the  matrix  is  formed,  a 1 in  the  resulting  matrix 
represents  that  a transition  can  be  made  in  N steps.  If  a Boolean  sum  is  taken  of  the 
first  N powers  of  C,  then  the  resulting  matrix  represents  whether  a transition  can  be 
made  in  N or  fewer  steps.  This  matrix  is  the  closure.  (Other,  more  efficient,  methods 
for  forming  the  closure  of  a matrix  are  known  [Warshall  62p 

IV.B.2.  Well-formed  graph  structure  criteria 

Three  basic  structural  properties  are  necessary  for  a well-formed  STEPPS 


graph  model.  They  are: 
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1.  Each  port  is  attached  to  a link. 

2.  Each  link  is  attached  to  at  least  one  input  port  and  one  output  port. 

3.  All  nodes  are  connected  to  each  other  via  some  set  of  paths,  i.e.  the  graph 
is  not  disjoint. 

The  last  property  means  that  for  any  partition  of  the  nodes  of  the  graph  into 
non-empty  subsets  of  nodes,  there  will  exist  at  least  one  connection  from  some  node 
in  each  subset  to  a node  outside  of  that  subset. 

The  first  two  properties  are  verified  by  examining  each  node  of  the  graph  and 
checking  the  connections  to  the  node.  The  third  property  is  determined  by  first 
forming  a node  connection  matrix  NC  where  nCj ^ ■ 1 if  node  i is  connected  to  node  j or 
if  node  j is  connected  to  node  ij  0 otherwise  (ignoring  that  the  graph  is  directed).  As 
before,  the  closure  of  the  NC  matrix  is  formed.  If  the  closure  contains  all  ones,  then 
there  exist  connections  between  every  pair  of  nodes. 

IV.C.  Deadlock  structures  and  situations 

The  nature  of  communication  dependencies  can  create  problems  for  a system  of 
interacting  communicators.  The  basic  problem  in  a STEPPS  model  is  that  processes  can 
achieve  states  such  that  at  least  one  process  will  never  be  able  to  change  state 
because  it  is  waiting  to  activate  its  associated  port;  this  is  called  the  deadlock 
problem.  In  some  STEPPS  structures  a deadlock  problem  may  be  so  severe  that  no 
process  can  ever  change  state  and  no  further  processing  of  any  kind  is  possible.  On 
other  structures  some  subparts  may  still  be  able  to  continue  processing  (possibly 
incorrectly).  A structure  that  is  completely  deadlock  free  is  defined  to  be  tafe. 

Either  of  two  views  may  be  taken  when  examining  a structure  for  deadlocks. 
The  first  view  is  that  a structure  must  not  con.ain  any  chance  of  an  occurrence  of  a 
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deadlock.  The  second  Is  that  . process  may  have  deadlocks  as  long  as  It  Is  possible  lo 
Identify  how  the  deadlocks  occor  and  the  probability  ot  their  occurrence.  The  term 
■deadlock*  In  the  STEPPS  model  refers  only  to  communication  structures  which  can  not 
be  removed  other  than  by  restructuring  a model.  In  practice  other  methods,  e.g.  es 
restarting  a process  after  an  unusually  long  delay,  are  sometimes  used  In  systems 

where  deadlocks  can  occur. 

The  deadlock  problem  has  been  studied  extensively  along  several  dimensions. 
The  survey  by  R.  C.  Holt  (Holt  72]  examines  many  of  the  deadlock  problems.  Most  of 
the  deadlock  algorithms  are  oriented  toward  solving  problems  concerned  with  resource 
requests  from  a pool  of  resources.  Holt  presents  s graph  model  of  the  resource 
problem  and  a set  of  graph  reductions  to  determine  whether  a modeled  system 
contains  deadlocks.  The  difference  between  the  STEPPS  solution  and  his  Is  that  Holt 
limits  his  analysis  to  necessary  conditions  (cycles)  and  sufficient  conditions  (a  knot*) 
lor  the  existence  of  a deadlock.  He  does  not  report  on  the  solution  of  the  general 
problem.  Several  problems  that  have  been  solved  have  been  concerned  with  reusable 
resources.  The  STEPPS  model  does  not  consist  of  reusable  resources  since  messages, 
which  ere  the  resources  In  STEPPS,  need  not  be  preserved.  The  STEPPS  model  Is 
somewhat  different  from  the  models  that  have  been  examined  In  pact  research,  so  the 
deadlock  problem  has  been  examined  and  wived  (with  a few  restriction.)  for  the 

STEPPS  model. 

The  following  sections  present  some  structures  and  situations  that  can  cause  a 
STEPPS  model  to  deadlock.  These  examples  are  not  necessarily  independent  nor 
complete,  but  they  demonstrate  some  types  of  deadlock  structures. 


t*" knot  is  a subset  of  nodes  of  a directed  graph  such  that  each  node  Is  attached  to 
the  other. 
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IV.C.l.  Initial  condition  Incompatibility 

It  is  easy  to  create  a structure  that  is  safe  for  some  initial  states  of  the 
components  of  the  structure,  but  not  for  others.  The  possible  problems  are  that  data 
are  not  available  where  required  or  that  the  system  contains  too  much  data.  For 
example,  all  output  ports  that  are  initial  states  might  be  attached  to  links  that  are 
Initially  at  capacity  and  all  initial  input  ports  might  be  attached  to  empty  links.  It  is  not 
necessary  for  such  a condition  to  occur  before  execution  begins;  the  condition  may 
also  occur  after  only  a few  state  transitions.  An  example  of  initial  condition  deadlock 
is  shown  in  Figure  IV-2.  In  this  example  process  C is  waiting  for  a message  from  B 
and  process  B is  waiting  for  a message  from  C.  Process  A will  always  be  waiting  to 
send  a message. 


VO 

Figure  IV-2.  Improper  initial  condition 


IV.C.2.  loops 

A loop  is  defined  to  be  a path  from  an  output  port,  0X,  of  a process  to  an  input 
port,  Iy,  of  that  process  with  no  connections  along  the  path  between  them  going  to  the 
original  process.  When  each  node  in  a loop  is  connected  only  to  other  nodes  in  the 
loop,  the  loop  is  called  a cloted  loop. 
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H any  port  of  aw  process  "Ode  .5  immadiat.-raturr.nt  (includint  the  nodes  at 
either  end),  then  it  is  possible  that  the  port  could  sand  (or  redoes!)  ..Ira  messages.  A 
solution  to  this  deadlock  problem  is  that  both  a Slf*’  and  a SOURCE*  must  be  attached 
to  nodes  in  the  loop.  Thus  the  loop  cannot  be  closed  when  Shore  is  an  immediate- 

recurrent  state  within  it  (Figure  IV-3). 

A loop  that  is  not  dosed  and  does  not  have  both  a S1M<  and  a SOURCE 
attached  to  nodes  in  the  loop  may  contain  deadlocks  because  it  may  be  possible  for  a 
message  to  be  shunted  to  the  SINK  or  any  other  process  not  in  the  loop.  Similarly, 
extra  messages  entering  a loop  from  a nod.  not  in  the  loop  et-  cause  a link  to  become 

filled  with  extra  messages. 


Figure  IV-3.  loop  with  immediate-recurrent  states 


*A  SINK  is  process  whose  only  port  is  an  input  port. 

*A  SOURCE  is  a process  whose  only  port  is  an  output  port. 
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IV.C.3.  Incompatible  sequences 

When  a data  path  can  be  recognized  as  a cloud  path?  It  is  possible  to 
determine  the  number,  N,  of  messages  required  to  enter  this  path  in  order  for  any 
messages  to  be  available  at  the  link  attached  to  th»  end  of  the  path.  It  is  also  possible 
to  determine  the  number,  M,  of  messages  that  will  be  available  at  the  end  of  the  path. 
The  link  attached  to  the  end  of  the  path  may  require  a certain  number  of  messages,  L, 
before  the  input  to  the  next  path  attached  to  It  can  yield  any  massages.  If  M does  not 
at  least  equal  L and  if  N,  M,  and  L are  finite  then  the  system  can  deadlock.  It  also  must 
be  true  that  fewer  than  2N  messages  enter  the  path  before  a response  Is  required 
from  the  path.  Figure  1V-4  shows  an  example  of  this. 


Figure  IV-4.  Incompatible  Sequence 


IV.C.4.  Split  paths  that  do  not  join  properly 

A data  path  may  split  in  two  ways.  If  a link  is  attached  to  more  than  one  inpu* 
port,  messages  that  reach  the  link  may  go  down  either  path.  If  the  paths  join  again  at 
two  different  ports  of  the  same  process  then  It  may  be  possible  for  Bn  insufficient 
number  of  messages  to  enter  one  of  the  paths  and  thus  force  the  merging  process  to 
wait  for  data  that  will  never  come.  Figure  IV-5  shows  this  situation,  where  processes 
A and  B send  messages  to  C and  C must  receive  a message  from  one  before  receiving 
a message  from  the  other. 

^A  closed  path  Is  a path  between  two  nodes  such  that  all  nodes  In  the  path  are 
attached  only  to  other  nodes  in  the  path. 


IV.O  Reducing  a STEPPS  model 


IV- 13 


Figure  IV-5.  Link  split  paths 

The  second  way  in  which  data  may  go  down  alternate  paths  occurs  when  a 
process  sends  data  along  two  different  paths  that  eventually  merge.  If  more  data  can 
go  down  one  path  than  can  be  received  by  the  port  at  the  end  of  the  path  then  this 
path  will  eventually  fill  up  with  messages.  The  two  processes  must  be  exactly 
synchronized  as  to  their  data  dependencies.  Figure  1V-6  shows  this  situation.  Every 
message  sent  by  A from  port  A.01  must  be  accepted  by  B.I1  and  the  same  Is  true  for 

A.02  and  B.I2. 


Figure  1V-6.  Process  split  paths. 


IV.D.  Reducing  a STEPPS  model 


Under  certain  conditions  it  is  possibie  to  determine  whether  a STEPPS  graph 
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model  is  deadlock-free.  The  conditions  are  that  the  graph  be  well-formed,  initial 
process  states  be  ignored,  and  the  initial  number  of  messages  and  queue  size  limits  be 
ignored.  The  method  used  to  determine  whether  a graph  is  safe  is  to  apply  a set  of 
graph  reduction *.  These  reductions  will  be  shown  to  reduce  all  safe  graphs  to  other 
safe  graphs  and  to  reduce  all  unsafe  graphs  to  other  unsafe  graphs.  In  addition,  it  will 
be  shown  that  one  of  the  reductions  is  always  applicable  to  a safe  graph.  Thus,  the 
reduction  process  may  be  repeatedly  applied  until  either  an  empty  graph  or  an 
irreducible  graph  is  reached.  When  an  empty  graph  is  produced  the  original  graph  is 
safe.  When  an  irreducible  graph  results,  then  the  original  graph  can  generate  a 
deadlock. 

There  are  four  graph  reductions  that  can  be  applicable  w,ten  certain  conditions 
are  met: 

Rl:  Combine  two  adjacent  processes. 

R2:  Eliminate  states  of  a single  process. 

R2a:  Combine  two  ports  of  the  same  type,  attached  to  the  same  link,  to 
become  one  port. 

R2b:  Eliminate  ports  of  opposite  type  connected  to  the  same  link. 

R2c:  Eliminate  ports  attached  to  SOURCE/SINKS. 

R3:  Combine  two  processes  that  are  in-parallel *. 

R4:  Eliminate  all  SOURCES,  SINKS,  and  unattached  links. 

Graph  Reduction  Process:  The  first  three  reductions  are  applied  iteratively 
until  none  is  applicable  and  then  the  last,  R4,  is  applied.  If  the  result  is  an  empty 
graph  then  the  model  is  safe}  otherwise  the  model  is  unsafe.  The  reduction  process 
sometimes  converts  the  graph  into  disjoint  parts,  and  this  is  necessary  to  the  reduction 
process. 

^Two  processes  are  in- parallel  when  each  process  has  exactly  one  input  port  and  one 
output  port  and  the  input  ports  of  the  respective  processes  are  connected  to  the  same 
link  and  the  output  ports  are  connected  to  the  same  link. 
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The  reductions  are  based  on  potential  interprocess  communications.  S'nce  a 
process  tronrition  relation  matrix  represents  the  presence  or  absence  of  possible 
interprocess  port  activations,  it  will  be  th«  vehicle  used  to  demonstrate  that  the 
reductions  maintain  process  legality.  Thus  by  proving  that  the  transitive  closure  of  a 
resultant  transition  relation  matrix  is  entirely  i’s,  each  reduction  is  demonstrated  as 
producing  resultant  processes  that  are  monodesmic  and  have  r,o  transient  states.1, 

IV.D.1.R1:  Combine  adjacent  processes 

Two  adjacent  proceuet*  are  combined  when  it  is  determined  that  their  data 
manipulation  functions  can  be  replaced  by  a single  process.  It  will  be  demonstrated 
that  the  combination  of  two  adjacent  processes  in  an  unsafe  graph  will  not  convert  the 

graph  into  a safe  one. 

R1  Is  applicable  in  two  situations: 

Rla:  neither  of  the  adjacent  ports  is  immediate-recurrent  and  they  repeat 
the  same  number  of  times. 

Rib:  one  of  the  processes  is  a DELAY11. 

For  Rla,  the  two  processes  are  combined  and  the  link  between  them  is  eliminated.  For 
Rib,  the  DELAY  and  the  link  between  the  processes  are  eliminated.  Rib  is  a trivial 
case  where  the  DELAY  is  functioning  as  a link.  The  remainder  of  this  subsection  is 
concerned  with  Rla. 

Rla  relies  on  the  assumption  that  each  of  the  two  adjacent  processes  will 


^ome  representative  probabilities  can  be  assigned  to  the  resultant  processes,  but 
these  will  not  be  presented  since  they  detract  from  the  clarity  of  the  explanation  of 
the  reductions. 

*Two  processes  are  adjacent  when  they  contain  adjacent  ports. 

11A  DELAY  is  a process  with  only  two  ports,  an  input  port  and  an  output  port, 
provided  neither  port  is  immediate-recurrent. 
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eventually  enter  the  states  of  their  adjacent  ports.  The  situation  can  be  modeled  as 
one  where  the  process  containing  the  output  port  sends  a message  to  the  other 
process  (and  waits),  and  this  second  process  computes  until  it  requires  another 
message  from  the  first  process.  Then  the  first  process  computes  until  it  reenters  the 
original  state.  In  this  way,  both  processes  are  able  to  change  state  if  one  can  (when 
the  graph  is  safe).  The  transition  relation  matrix  of  the  combined  process  is  formed  by 
a construction  that  (i)  eliminates  the  adjacent  ports  and  (ii)  unites  the  successors^  of 
states  that  immediately  preceded  an  eliminated  state  of  one  process  with  the 
successors  of  the  state  of  the  second  process.  In  this  way  the  new  combined  process 
is  still  monodesmic  and  without  transient  states  since  each  state  is  still  able  to  enter 
each  other  state,  but  now  may  go  through  states  of  what  was  formerly  part  of  a 
different  process. 

The  new  transition  relation  matrix  is  formed  in  the  following  manner.  Let  the 
ports  A.e  and  B.f  be  adjacent  and  let  neither  state  be  immediate-recurrent.  Let  A.x, 
A.z,  B.y  and  B.w  be  other  ports  of  the  two  processes.  If  the  new  combined  process  is 
called  AB,  then  c’(AB.x,AB.z)  ■ c(A.x,A.z),  c’(AB.y,AB.w)  ■ c(B.y,B.w),  c’(AB.x,AB.y)  ■ 
c(A.x,A.e)  a c(B.f,B.y)  and  c’(AB.y,AB.xJ  ■ c(B.y,B.f)  a c(A.e,A.<)*- 

Lemma  Rl.l:  If  A.e  succeeds  A.x  and  B.y  succeeds  B.f,  then  AB.y  succeeds 

» 

AB.x,  i.e.  c’(  AB.x, AB.y)  - 1. 

Proof:  A.e  succeeds  A.x  means  c(A.x,A.e)  ■ 1 and  B.y  succeeds  B.f  means 
c(B.f,B.y)  - 1.  Therefore  c’(AB.x,AB.y)  - c(Ax,Ae)  a c(B.f,B.y)  - 1 A i - 1. 

Lemma  Ri.2:  If  B.f  succeeds  B.y  and  A.x  succeeds  A.e,  then  AB.x  succeeds 

AB.y. 

* The  tuccettor  ttatet  of  a state  are  those  that  can  be  entered  in  one  transition. 

*c(s,t),  a transition  relation  matrix  entry,  is  defined  to  be  the  presence  (1)  or  absence 
(0)  of  probability  of  entering  state  t from  state  s.  c’(w,u)  is  a transition  relation  matrix 
after  the  application  of  a reduction.  All  operators  ( a and  v ) are  logical  operators. 
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Proof:  As  in  Lemm*  Rl.l. 

L amnia  R1.3:  Thera  exists  a sequence  ol  transitions  from  AB.x  to  AB.y. 

Preoti  Since  A and  B are  assumed  to  be  legal  STEPPS  processes,  their 
respective  transitive  closure  transition  relation  matrices  are  all  IV  As  a property  of 
transitive  closure,  this  means  that  there  exists  a sequence  ot  transitions  from  A.x  to 
each  predecessor  ol  A.e  and  their  respective  similar  slates  in  AB.  Similarly  there 
exists  a sequence  ol  transitions  Iron,  successors  ol  Bl  to  B.y  and  their  respective 
similar  states  in  process  AB.  By  lemma  Rl.l  and  the  above,  there  exists  a sequence  ol 
transitions  Irom  AB.x  to  each  corresponding  successor  ol  Bl  and  thus  to  AB.y. 

Lemma  Rl.».  There  exists  a sequence  ol  transitions  from  AB.y  to  AB.x. 

Proof:  As  in  Lemma  R1.3. 

Lemma  R15:  Process  AB  is  a legal  STEPPS  process,  i.e.  the  transitive  closure 

Of  the  corresponding  transition  relation  matrix  is  all  l’s. 

Proof;  By  Lemmas  R1.3  and  Rl.A,  there  are  sequences  ol  transitions  between 

each  stale  that  was  originally  in  A to  each  state  originally  in  B and  visa-versa. 
Therefore  by  juxtaposing  sequences  ol  transitions  there  exist  sequences  ol  transitions 
between  any  two  chosen  stales  of  AB.  By  the  definition  ol  transitive  closure  this 
corresponds  to  all  l’s  in  the  transitive  closure  transition  relation  matrix  for  AB. 


Example  IV.D- 1 


The  processes  in  Figure  1V-7  are  i by  forming  a Process  ^ 

two  states  fewer  than  the  total  number  of  states  of  the  origma  two 
processes.  As  shown  by  the  transition  rela  ion  matrices,  .11  of  the 
predecessor  states  of  the  output  process  now  transfer  to  the  successor 
states  of  the  input  process.  All  of  the  predecessor  states  of  the  input 
process  now  transfer  to  the  successor  states  of  the  output  processes. 


Theorem  R].:  R1  (combine  adjacent  processes)  preserves  the  message  flow 
structure  of  • model  with  respect  to  graph  elements  not  involved  in  the  reduction 
(whether  or  not  the  original  graph  was  safe). 
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B 13  14  03  04 

13 

14 

03 

04 

AB  II  12  14  02  03  04 
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12 
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Figure  IV-7.  Process  combinations 


Proof:  Let  A and  B be  the  original  processes  and  let  AB  be  the  result  of 
combining  them.  It  will  be  shown  that  any  message  that  could  be  requested  by  A or  B 
can  be  requested  by  AB  and  that  any  message  that  would  be  sent  by  A or  B to  a link 
will  be  sent  by  AB. 

By  Lemma  R1.5,  the  new  process  Is  monodesmic  and  has  no  transient  states. 
Coupled  with  the  reduction  definition,  this  means  that  all  states  of  AB  can  be  entered 
exactly  as  often  as  in  the  original  processes,  A and  B.  Thus  all  input  ports  of  AB  are 
guaranteed  to  be  able  to  receive  messages  if  they  originally  could,  so  the  state 


IV.D  Reducing  a STEPPS  model 


IV- 19 


associated  with  a given  input  port  will  always  be  able  to  change.  Likewise  each  state 
associated  with  an  output  port  of  AB  can  change  to  another  state  if  It  could  originally. 
For  these  two  reasons  all  messages  that  would  be  requested  by  A or  B will  be 
requested  by  AB  and  all  messages  that  would  be  sent  by  A or  B will  be  sent  by  AB. 

1V.D.2.  R2t  Eliminate  states  of  a process 

There  are  three  circumstances  In  which  a state  of  a process  may  be  removed 
by  applying  reduction  R2.  There  are  two  distinct  methods  of  removing  a state: 
combine  two  states  to  become  one;  and  eliminate  a state.  As  with  Rl»  the  removal  of  a 
state  does  not  affect  data  flow  patterns.  (An  exception  is  that  the  combination  of  two 
states  into  one  sometimes  modifies  the  r timber  of  times  a state  repeats.) 

The  method  used  to  combine  two  itata  into  one  state  is  defined  as  follows. 
Let  A.x  and  A.y  be  the  names  of  the  states  of  process  A being  combined.  For 
convenience,  the  resultant  combined  state  will  be  called  A.x.  The  rule  for  combining 
the  states,  in  terms  of  the  transition  relation  matrix  for  process  A,  is: 

Let  A.z  be  a state  of  process  A that  is  neither  A.x  nor  A.y,  i.e.  it  will  remain 

after  the  reduction. 

c’(A.x,A.z)  ■ c(A.x,A.z)  v c(A.yAz) 
c ’(A.z, A.x)  ■ c(A.z,A.x)  v c(A.z,A.y) 
c’(A.x,A.x)  ■ c(A.x,A.x)  v c(A.yAx)  v c(A.yAy)  v c(A.x,Ay) 

The  above  means  that  any  successor  of  A.y  becomes  a successor  of  Ax,  and 
any  predecessor  of  A.y  becomes  a predecessor  of  A.x. 

Lemma  R2.1:  The  reduction  to  combine  ttatet  yields  a legal  process. 

Proof:  It  must  be  shown  that  the  resultant  process  has  no  transient  states  and 
Is  monodesmic.  The  original  process,  A,  was  legal  and  thus  there  existed  finite 
sequences  of  transitions  from  each  state  to  each  other  state.  The  construction  of  the 
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new  process  by  combine  ttatet  guarantees  a legal  process  since  (a)  if  there  existed  a 
sequence  of  transitions  between  two  states  without  going  through  A.y,  the  reduction 
does  not  alter  the  sequence  and  (b)  any  sequence  of  transitions  that  went  through  A.y 
will  now  go  through  A.x  instead. 

The  method  used  to  eliminate  a tt ate  of  a process  is  defined  as  follows.  Let 
A.x  be  the  state  being  eliminated  and  let  A.y  and  A.z  be  other  states.  The  rule  for 
eliminating  a state,  in  terms  of  the  transition  relation  matrix  for  process  A,  is: 
c’(A.y,A.z)  ■ c(A.y,A.z)  v (c(A.y,A.x)  a c(a.x,A.z)) 

The  above  means  that  A.y  preceeds  A.z  either  if  it  did  before  the  reduction  or 
If  A.y  preceeded  A.x  and  A.x  preceeded  A.z. 

Lemma  R2.2:  The  reduction  to  eliminate  a state  yields  a legal  process. 

Proof:  A sequence  of  transitions  between  two  states  not  going  through  A.x 
still  exists  after  the  reduction.  A sequence  of  transitions  that  went  through  A.x,  simply 
skips  A.x  after  the  reduction.  Thus  the  reduction  yields  a process  that  is  monodesmic 
and  has  no  transient  states. 

R2a:  When  two  ports  of  the  same  type  are  connected  to  the  same  link  one  port  is 
removed,  depending  on  one  of  the  following  conditions. 

(i)  Each  of  the  two  states  can  succeed  the  other  in  one  transition.  This 
means  that  the  states  are  equivalent  to  one  immediate-recurrent  state. 
The  two  states  are  combined  to  become  one  state. 

(ii)  The  successor  states  of  the  two  states  are  the  same  (not  counting  each 
other).  This  means  that  the  states  act  as  one  state  with  possibly  different 
transition  probabilities  from  the  original  states.  The  two  states  are 
combined  to  become  one  state. 

(Hi)  The  two  states  are  in-sequence,  i.e.  one  state  will  enter  the  other  with 
certainty.  Alternatively,  they  may  be  one-to-one.  This  means  that  the 
two  states  are  really  one  with  finite  repetition.  One  of  the  states  is 
eliminated. 

Note  that  a link  is  also  eliminated  by  reduction  R2  when  all  ports  that  had  been 
attached  to  the  link  are  deleted. 
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R2b:  When  a link  is  only  attached  to  both  Input  and  output  ports  of  process,  then 
pairs  of  these  Input/output  ports  of  the  same  process  that  are  one-to-one  and  repeat 
the  same  number  of  times  can  be  eliminated.  When  this  st  ucture  occurs,  every 
message  sent  to  the  link  is  guaranteed  to  be  requested  by  one  of  the  other  ports  of 
the  process.  If  the  ports  are  the  last  two  connected  to  the  link  then  the  link  is  also 

removed. 

Example  IV.D-2 

In  Figure  IV-8,  ports  II  and  03  are  adjacent  and  are  one-to-one.  They 
are  eliminated  as  shown. 


Becomes 
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ALPHA  12  04 
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04  1 1 


12  ALPHA  04 


Figure  IV-8.  Adjacent  ports  of  a process 

R2c:  A state  that  is  attached  to  a SOURCE/SINKf  is  eliminated,  since  once  it  is 
entered,  the  process  can  always  be  assured  of  being  able  to  enter  a new  state.  If  the 


fA  SOURCE/SINK  is  either  a SOURCE  or  a SINK  depending  on  the  context.  A SOURCE 
wouid  be  attached  to  an  input  port,  whereas  a SINK  would  be  attached  to  an  output 
port. 


state  Is  the  last  state  of  a process  then  the  entire  process  Is  eliminated  If  the  port 
was  the  last  port  attached  to  a link  then  the  link  is  also  eliminated. 

Example  IV.D-3 

In  Figure  1V-9,  both  ports  14  and  06  are  attached  to  SOURCE/SINKS. 

They  are  both  eliminated. 

Theorem  R2:  R2  (eliminate  states  of  a process)  preserves  the  message  flow 
structure  of  a model  with  respect  to  graph  elements  not  involved  In  the  reduction 
except  for  links  attached  to  SOURCE/SINKS 

Proof:  Let  A be  a process  that  is  reduced  to  A’.  By  Lemmas  R2.1  and  R2.2 
each  state  of  A’  can  always  be  entered.  The  cases  to  be  considered  are  enumerated 
by  looking  at  how  a link  was  attached  to  A and  then  to  A*. 

A link  that  was  attached  to  A and  not  to  a port  of  A that  was  eliminated  by  the 
reduction  will  still  have  the  same  interaction  with  A’  as  with  A since,  by  construction, 
any  states  that  would  have  entered  an  eliminated  state  will  transfer  to  a successor  of 
the  eliminated  state.  Thus  the  state  that  Is  attached  to  the  link  will  occur  just  as  often 
in  A’  as  In  A. 

A link  that  was  attached  to  A and  is  attached  to  A’,  but  by  one  fewer  port,  will 
still  have  the  same  Interactions  with  A’  as  with  A since  the  remaining  connections  to  A’ 
are  constructed  to  guarantee  this.  Two  states  of  the  same  type  that  are  attached  to 
the  same  link  and  succeed  each  other  act  like  an  Immediate-recurrent  state  since  any 
number  of  link  interactions  can  occur  before  a different  state  Is  entered.  Two  states 
of  the  same  type  have  the  same  successor  states  and  are  acting  in  the  same  manner  as 
one  state  except  for  different  probabilities  to  the  successor  states.  Two  states  of  the 
same  type  that  are  in-sequence  and  are  attached  to  the  same  link  act  like  one  state 
that  repeats  before  entering  another  state. 
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Figure  1V-9.  Ports  attached  to  SOURCE/SINKS 

A link  that  was  attached  to  A and  is  attached  to  A’  by  two  fewer  ports  occurs 
when  pairs  of  input/output  ports  are  removed.  The  message  flow  is  preserved  since 
the  ports  were  only  removed  if  they  were  one-to-one.  This  means  that  whenever  a 
message  Is  sent  to  (requested  from)  the  link,  it  Is  guaranteed  that  a message  will  later 
be  requested  from  (sent  to)  the  link.  A link  that  was  only  attached  to  those  two  ports 
Is  removed  as  part  of  the  reduction.  Since  the  message  flows  to  and  from  the  link 
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were  eliminated  with  the  link,  the  remainder  of  the  graph  is  the  same.  This  completes 
the  proof. 

By  assumption,  Theorem  R2  is  not  concerned  with  links  that  had  been  attached 
to  SOURCE/SINKS  and  are  no  longer  attached  to  a port  of  a process.  This  situation  is 
represented  by  reduction  R2c.  Messages  flow  between  a SOURCE/SINK  and  the 
reduced  process.  The  reduction  occurs  by  considering  the  SOURCE/SINKS  as  message 
suppliers  and  terminators.  Reduction  R4  eliminates  these  processes  and  so  message 
flow  involving  them  is  eliminated. 

IV.D.3.  R3:  Combine  processes  that  are  in-parallel 

When  two  processes  are  in-parailei,  each  process  has  only  one  input  and  one 
output  port  and  both  processes’  input  ports  are  et^hsd  to  the  same  link  and  both 
output  ports  are  attached  to  the  same  link.  When  a message  is  in  the  queue  of  the 
common  link  attached  to  the  processes’  input  ports,  it  can  be  requested  by  either  of 
the  processes.  Whenever  the  choice  will  not  affect  message  flow  the  two  processes 
are  combined.  In  particular,  an  immediate-recurrent  state  subsumes  the  function  of  the 
state  of  the  process  that  is  attached  to  the  same  link.  Thus  a DELAY  that  is  in-parallel 
with  other  processes  containing  two  states  is  eliminated. 

A BLACK  BOX  is  a process  having  just  two  ports,  one  output  port  and  one 
input  port.  Both  associated  states  are  immediate-recurrent.  Any  process  that  is  in- 
parallel with  a BLACK  BOX  can  be  removed  since  the  BLACK  BOX  subsumes  the 
operation  of  the  other  process. 

Let  the  two  processes  be  ALPHA  and  BETA  with  ports  ALPHA.Ii,  ALPHA.Ol, 
BETA.I1  and  BETA.01  (Figure  IV-10).  The  second  process,  BETA,  will  be  the  combined 
process.  The  new  transition  relation  matrix  is  defined  by: 

c’(BETA.Ii,BETA.Il)  ■ c(BETA.U,BETA.Il)  v c(ALPHA.Il,ALPHA.Il) 
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c’(BETA.I 1 ,BET A.0 1 ) ■ c(BETA.Il,BETA.01)  v c(ALPHA.Il,ALPHA.01) 
c’(BET A.0 1 ,BET A.1 1 ) ■ c(BETA.01,BETA.Il)  v c(ALPNA.01,ALPHA.Il) 
c’(BETA.01,BETA.01)  • c(BETA.0I,BETA.01)  v c(  ALPHA.Ol  ,ALPHA.O 1 ) 

It  is  obvious  from  these  simple  equations  that  the  new  transition  matrix  is  legal. 


^ 

> 

11  ALPHA  01 

> 

a 

a 

a Becomes 



11  BETA  oi 

_ _ \ 

a 

^ 

* wvvvii  wo  a 

• s,  • . 

1 ? 

> 

Ii  BETA  01 

> 

Figure  IV-10.  Combining  processes  that  pro  in-parallel. 

Theorem  R3:  R3  (eliminate  processes  that  are  in-parallel)  preserves  the 
message  flow  of  i model  with  respect  to  graph  elements  not  involved  in  the  reduction. 

Proof:  If  one  of  the  input  ports  that  is  attached  to  the  link  attached  to  the 
input  ports  of  the  two  processes  is  immediate-recurrent,  tnen  it  is  possible  that  an 
undeterminable  number  of  messages  can  be  requested  by  the  processes  before  a 
message  is  sent  to  the  link  attached  to  the  processes’  output  ports.  Thus,  if  one  input 
' slate  is  immediate-recurrent  then  the  elimination  of  the  other  does  not  affect  the 
number  of  messages  that  can  be  accepted  by  the  reduction  of  the  pair  of  process 
into  one  process.  Likewise  if  one  of  the  output  ports  is  immediate-recurrent,  any 
number  of  messages  can  be  available  at  the  link  attached  to  the  output  ports  and  so 
the  other  output  port  is  eliminated. 

If  neither  input  port  is  immediate-recurrent  then  the  combination  of  two  input 
ports  is  the  same  as  one  of  them  requesting  a message  twice,  so  the  other  can  be 
eliminated.  Likewise  if  neither  output  port  is  immediate-recurrent  then  the  combination 
is  the  same  as  one  sending  two  messages  to  he  link  and  so  the  other  output  port  can 


be  eliminated. 
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IV.D. 4.  R4:  Remove  SOURCES  and  SINKS 

Since  the  original  graph  was  well-formed,  all  links  were  originally  connected  to 
both  input  and  output  ports.  However,  reduction  R2c  removes  all  connections  of  one 
type  to  a link.  When  R2c  is  no  longer  applicable,  no  process  is  attached  to  a 
SOURCE/SINK.  Thus  SOURCES  and  SINKS  can  be  attached  to  links,  but  serve  no  other 
purpose  than  to  have  allowed  R2c  to  occur.  They  are  eliminated.  If  the  SOURCE/SINK 
is  the  last  connection  to  a link  then  the  link  is  eliminated  too. 

Theorem  R4:  The  elimination  of  SOURCES  and  SINKS  preserves  message  flow 
of  those  elements  not  attached  to  the  SOURCE/SINKS. 

Proof:  This  is  true  since  reduction  R4  occurs  after  Rl,  R2,  and  R3  are  no 
longer  applicable  and  since  R2  eliminates  all  connections  to  SOURCE/SINKS  other  than 
the  connections  between  a link  and  a SOURCE/SINK.  Any  other  elements  in  a graph 
are  left  unaffected  since  they  are  not  connected  to  any  SOURCE/SINKS. 

IV.D.5.  Graph  redueibility 

The  remaining  requirements  to  show  the  validity  of  the  reductions  are  that  a 
safe  graph  is  always  reducible  and  that  an  always  reducible  graph  is  safe. 

Reducibilitv  Theorem:  A non-empty,  well-formed,  but  not  necessarily 

connected,  safe  graph  is  always  reducible.  (Equivalently,  an  Irreducible  graph  Is  not 
safe.) 

Proof:  Assume  the  existence  of  an  irreducible  graph  and  consider  all  possible 
connections  to  a link  in  the  graph.  The  implications  of  the  inapplicability  of  any  of  the 
reductions  are  as  follows.  There  e four  cases: 

Casel:  A link  is  connected  to  only  input  and  output  ports  of  one  process. 
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Since  reduction  R2  Is  not  applicable,  then  no  pairs  of  these  ports  are  one-to-one  and 
eo  at  least  one  of  the  ports  can  dominate  the  activity  at  the  link.  This  will  cause  the 
state  associated  with  the  other  ports  to  wait  Indefinitely  since  eventually  either  no 
messages  will  be  available  at  the  link  or  the  link’s  finite  queue  size  limit  will  be 
reached.  This  Is  a deadlock  situation. 

Case2:  A link  is  connected  to  only  two  ports,  of  the  same  type,  of  different 
processes,  i.e.  adjacent  processes.  Since  reduction  R1  is  not  applicable,  one  of  the 
adjacent  ports  is  immediate-recurrent.  It  is  possible  for  one  of  the  processes  to 
dominate  the  activity  at  the  link.  This  will  cause  the  other  port  to  wait  indefinitely 
since  eventually  either  no  messages  will  be  available  at  the  link  or  the  link  s finite 
queue  size  limit  will  be  reached.  This  is  a deadlock  situation. 

Case3:  A link  is  connected  only  to  ports  of  the  same  type  of  one  process 
connected  to  the  link.  Since  reduction  R2  is  not  applicable,  no  pairs  of  corresponding 
states  (i)  succeed  each  other,  (ii)  have  the  same  successor  states,  and  (iii)  are  In- 
sequence. When  a message  is  requested  from  (or  available  to)  the  link,  there  is  no 
guarantee  which  port  w'll  request  (send)  a message  first.  This  makes  a difference 
since  the  successor  states  of  the  two  ports  are  different.  There  are  no  SOURCE/SINKS 
in  an  irreducible  graph  so  It  is  impossible  to  guarantee  that  another  link  access  will 
occur  due  to  access  from  other  processes.  In  addition,  there  are  no  DELAYS  nor 
adjacent  one-to-one  ports  of  a process  and  so  there  are  no  additional  guaranteed  link 
accesses  due  to  the  process  itself.  Therefore  a process  can  deadlock  because  the 
wrong  port  can  access  the  link  first. 

Case4:  At  least  two  ports,  of  the  same  type,  of  different  processes  are 
connected  to  a link.  Since  reduction  R3  is  not  applicable,  none  of  the  corresponding 
processes  are  in-parallel.  Thus  the  operation  of  the  model  can  be  affected  by 
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whichever  of  the  processes  performs  the  first  link  access.  It  is  also  possible  for  one 
process  to  dominate  the  activity  at  a link.  There  are  no  SOURCE/SINKS  and  so  no 
guarantees  of  an  eventual  link  access.  The  situation  can  cause  a deadlock  when  the 
wrong  process  accesses  the  link  first. 

It  has  been  shown  that  all  possible  connections  to  the  link  yield  a deadlock. 
Therefore  an  irreducible  graph  is  not  safe.  The  contrapositive  of  this  is  that  a safe 
graph  is  reducible. 

The  arguments  of  this  section  have  demonstrated  that  an  irreducible  graph  is 

unsafe  and  have  proved  the  Reducibility  > heorem. 

Irreducibilitv  Theorem:  An  unsafe  graph  is  not  always  reducible.  (Equivalently, 

a graph  that  is  always  reducible  is  safe.) 

Proof;  Let  X be  a graph  that  is  always  reducible.  Assume  that  X is  not  safe. 

It  will  be  shown  that  this  is  impossible. 

By  Theorems  Rl,  R2,  R3  and  R4,  the  reductions  Rl,  R2,  R3  and  R4  each 
preserve  potential  message  flow  in  the  graph  with  respect  to  those  graph  elements 
not  involved  in  the  reduction.  Thus  no  reduction  can  cause  a deadlock  due  to 
interprocess  communication  no‘  »n  olved  with  the  reduction.  Further,  by  the  definition 
of  each  reduction  and  by  Lemmas  R1.5,  R2.1,  R2.2  and  Theorem  R3,  a reduction  is  only 
applicable  to  a safe  element  struc‘ure  and  produces  a legal  and  a safe  element 
structure  Thus  a reducible  gr«iph  is  safe. 

Example  IV.D-4 

Figure  IV-11  shows  an  example  of  an  irreducible  graph  since  the 
following  set  of  state  transitions  could  occur  in  sequence: 

1.  A.Ol 

2.  C.I1 

3.  A.02 

4.  B.ll 

5.  B.Ol 

6.  A.01 


IV.E  The  recognition  of  deadlocks 


1V-29 


7.  Repeat  3 to  6 until  the  link  L2  becomes  full. 

8.  C tries  to  perform  C.I2,  but  can  not  since  LI  is  empty.  B can  not 
change  state  since  LI  Is  empty.  A can  not  change  state  since  L2  Is  full. 
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Figure  IV-11.  At  irreducible  graph 


IV.E.  The  recognition  of  deadlocks 

Graph  Reduction  Theorem:  Assuming  that  a STEPPS  model  is  well-formed,  that 
initial  conditions  are  igi.ored  and  that  queue  sire  limits  are  ignored,  the  Graph 
Reduction  Process  will  yield  an  empty  graph  if  and  only  if  the  original  graph  is  safe. 

Proof:  By  the  Reducibility  Theorem  a safe  graph  is  always  further  reducible. 
By  the  Ir reducibility  Theorem  an  always  reducible  graph  is  safe.  Thus  after  the  Graph 
Reduction  Process  is  completed,  if  the  result  is  an  empty  graph  then  the  original  graph 
was  safe;  otherwise  the  original  graph  was  unsafe.  This  completes  the  proof. 
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The  graph  reductions  do  not  solve  the  problem  of  initial  state  incompatibility. 
This  situation  can  be  recognized  by  examining  each  process’s  initial  state  and  the 
attached  links.  If  all  initial  output  ports  are  attached  to  links  that  are  full  and  if  all 
initial  input  ports  are  attached  to  links  that  are  empty  then  the  model  is  initially 
deadlocked. 

It  is  still  possible  for  a model  to  enter  a deadlock  before  the  model  reaches 
steady  state  due  to  link  queue  length  limits  and  initial  queue  volumes.  A solution  to 
this  problem  is  a requirement  that  no  link  attached  to  an  initial  output  port  be  full 
initially.  Also  these  links  can  not  be  attached  to  input  ports  that  are  the  initial  states 
of  another  process.  In  addition,  not  all  of  the  processes  can  be  in  initial  states;  that 
are  connected  to  links  containing  no  messages.  This  is  net  2"  optimal  solution  since  a 
system  may  still  be  safe  if  some  output  ports  are  initially  full.  However  the 
requirement  is  a reasonable  one  to  model  and  can  be  altered  easily  when  steady  state 
properties  are  known. 
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Chapter  V 

The  STEPPS  Simulator  and  STEPPS  Interactive  System 


Since  rmny  performance  properties  of  realistic  programs  are  difficult  to  treat 
analytically,  a STEPPS  model  is  simulated  to  collect  data  which,  In  turn,  Is  analyzed  to 
predict  performance  properties  of  a program.  The  STEPPS  simulator  and  the 
implementation  of  the  STEPPS  system  are  presented  in  this  chapter. 

V.A.  Simulation  objectives 

An  issue  concerning  the  structure  of  a multiprocess  program  is  whether  a 
particular  program  decomposition  can  be  improved,  i.e.  Is  it  a good  decomposition.  As 
noted  in  Chapter  I,  this  research  does  not  address  the  issue  of  whether  the  designed 
program  solves  the  problem  under  consideration.  The  STEPPS  simulation  facilities 
serve  to  enhance  predictive  performance  understanding  in  the  situation  where  a model 
is  so  complex  that  it  is  essentially  analytically  intractable  Another  situation  occurs 
when  a model  may  be  analytically  tractable,  but  very  time  consuming  to  solve, 
especially  when  some  modifications  are  made  to  it. 

Specific  performance  issues  concerning  a STEPPS  model  are  the  following: 

1.  How  much  time  will  be  spent  computing  for  each  state  of  a process? 

2.  In  which  states  will  a process  be  waiting  and  for  how  much  time? 

3.  Are  the  queue  sizes  too  small  or  too  large? 

4.  What  are  the  expected  rates  of  data  flow  to  a link  and  of  requests  from  a 
link? 

5.  What  is  the  overhead  due  to  interprocess  communication? 
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6.  Which  sets  of  processes  tend  to  be  active  at  the  same  time  and  which 
processes  are  usually  active  at  different  times? 

7.  How  many  processes  are  active  on  the  average? 

8.  What  ore  the  effects  of  limiting  the  number  of  available  processes  and 
using  a variety  of  scheduling  algorithms? 

The  first  question  can  be  answered  by  performing  the  semi -Markov  analysis 
described  In  Chapter  IV.  However,  all  of  the  other  questions  are  more  difficult  to 

answer  because  they  deal  with  interprocess  activity. 

Consider  the  question  of  h;w  long  a process  will  wait  in  each  state.  This  value 

may  depend  upon  all  of  the  possible  interactions  in  a model.  For  example,  consider  ti  e 
ring  of  processes  shown  in  Figure  V-l.  If  all  of  the  processes  are  DELAYS  and  there 
Is  only  one  message  In  the  loop,  then  the  wait  time  at  each  input  port  is  the  time 
required  for  the  message  to  traverse  the  loop  when  there  is  initially  only  one  message. 
The  problem  Is  more  difficult  when  there  are  initially  several  messages  in  the  loop  and 
when  the  processes  are  more  complex.  Simulation  Is  used  to  answer  such  questions. 


Figure  V-l.  A ring  of  processes 

Queueing  theory  can  be  used  to  solve  the  same  question  and,  in  fact,  to 
produce  a more  exact  result,  given  assumptions  based  on  known  or  estimated 
probability  distributions  [Kleinrock  75}  However,  there  are  seemingly  simple  program 
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structures  modeled  by  STEPPS  that  are  difficult  to  solve  using  queueing  theory.  Each 
queueing  model  must  be  solved  individually  and  the  applicable  techniques  do  not 
always  transfer  when  systems  with  as  many  parameters  as  a STEPPS  model  has  are 
involved;  these  limitations  of  queueing  theory  are  well  known  [Fishman  73,  McMillan 
68].  STEPPS  has  been  designed  to  be  applicable  to  a variety  of  system  structures  and 
to  make  analysis  easy  for  a system  designer.  In  particular,  simulation  allows  rapid 
interactive  experimentation  with  a number  of  alternative  problem  decompositions. 

V.B.  Simulation  operation  and  data  collected 

In  order  to  discover  the  answers  to  the  questions  discussed  in  the  last  section, 
it  is  necessary  to  collect  a sufficient  amount  of  data  by  simulating  a modeled  program. 
The  approach  taken  in  this  research  is  to  make  it  possible  to  collect  as  much  data 
describing  the  operation  of  processes  and  links  as  might  be  expected  to  be  useful. 
The  implementation  of  the  data  collection  facilities  has  been  carefully  designed  to 
facilitate  the  incorporation  of  additional  facilities  so  that  other  than  built-in  analysis 
can  be  used. 

The  operation  of  a STEPPS  model  was  described  in  Chapter  II.  At  every 
possible  change  of  simulated  state^  of  a STEPPS  model  it  is  possible  to  collect  data. 
Thus  the  specific  operation  of  a process,  a link,  and  the  process  scheduler  will  be 
described  below  and  the  data  collected  at  e ach  operation  change  will  be  noted. 


^State  in  this  instance  refers  to  the  condition  of  the  entire  model,  namely  all 
processes,  all  links  and  the  process  scheduler. 
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V.B.l.  Procesa  activity  and  the  data  collected 


A simulated  process  goes  through  a sepuenc.  o.  actions  that  represent  its 
activity.  At  each  action  the  simulation  system  records  the  most  recent  action  and 
collects  appropriate  data  concerning  the  action.  The  specific  data  collection  points  and 

data  collected  at  these  points  are: 

1.  Activating.  When  a process  is  initialized  all  data  collection  facilities  are 
also  Initialized. 

^..elusive, y access  ,h. 

link  (a  MP"  operation  on  a semaphore). 

3 Mutex.  The  time  that  is  spent  waiting  on  the  link’s  exc,us'^e 

semaphore  is  accumulated  Next  the  process  must  8u®ran*e*  means  of  a 
will  be  able  to  recognize  the  access.  This  is  accompnsneu  y 
mutual  exclusion  between  the  link  and  the  process. 

p.  Sfocio.  Th,  ..me  waiting  for  th.  link  S 

the  process  performs  its  link  access.  The  process  then  wans 
to  respond.  The  time  for  initializing  this  wait  is  recorded. 

5.  I oread  y.  The  time  spent  waiting  before  the  I/O  operation  can  occur  is 
accumulated. 

6.  Incomplete.  The  time  spent  performing  th.  1/0  operation  is  accumulated. 

activity  relating  to  the  current  state  is  complete. 

a Choote.  The  process  then  chooses  which  will  be  the  next  state  No  data 
are  collected  at  this  point  since  this  operation  takes  no . time.  W 
operation  of  the  model  is  traced  this  change  of  state  is  noted. 

9.  Computing.  The  start  of  a process  compute  time  Is  recorded. 

10.  Endcompute.  The  time  spent  computing  in  the  current  state 
accumulated. 

11.  Rcsfortin,.  Th.  process  is  ready  to  be  restarted  and  must  be  scheduled. 
The  time  is  recorded. 


tSee  Appendix  A for  description  of  using 


the  simulator  and  tracing  a simulation. 
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12.  Readied.  When  the  scheduler  allows  the  process  to  proceed  the  time 
spent  waiting  while  ready  to  run  is  collected. 

Activities  2 through  10  represent  a more  detailed  description  of  the  operation 
of  a process  than  is  described  in  Chapter  II.  Steps  11  and  12  accumulate  data 
concerning  the  time  a process  spends  waiting  to  be  scheduled.  Analysis  of  the  data  is 
discussed  below. 


V.B.2.  LinK  activity  and  data  collected 


The  sequence  of  actions  that  a link  goes  through  represents  changes  in  the 
link’s  queue  size,  number  of  message  requests,  and  time  used  by  the  link  (if  any).  At 
each  change,  th'  simulation  notes  the  new  activity  and  collects  appropriate  data 

concerning  the  change.  The  activities  of  a link  are: 

1.  Inactive.  A link  will  be  inactive  until  it  is  accessed.  The  time  when  the 
link  becomes  inactive  is  recorded. 

2.  Inacceu.  A link  has  been  accessed  by  an  input  port.  Accumulate  the 
amount  of  time  between  input  request  accesses  and  count  the  number  of 

accesses. 

3.  Outaccet*.  A link  has  been  accessed  by  an  output  port.  Accumulate  the 
amount  of  time  between  message  available  accesses  and  count  the  number 
of  accesses. 

4.  Exclude.  The  link  has  been  accessed  and  the  time  it  was  inactive  is 
accumulated.  The  link  now  prevents  any  other  access  to  itself  by  means 
of  mutual  exclusion  synchronization. 

5.  Accrued.  The  time  the  link  waited  to  exclude  other  accesses  is 
accumulated. 

6.  Starting.  If  the  link  had  to  be  restarted,  the  number  of  restarts  is 
accumulated. 

7.  Started.  The  time  after  restarting  is  recorded. 

8.  (Himii.  If  the  link  has  no  more  room  for  messages  (its  queue  size  limit  has 
already  been  reached),  then  the  number  of  overflow  messages  is 
accumulated  over  time.  This  is  the  average  number  of  processes  that  had 
to  wait. 
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9.  Accept.  If  the  link  can  accept  a message  then  the  queue  length  is 
accumulated  over  time. 

10.  Eninccept.  The  time  after  accepting  a message  is  recorded. 

11.  Arcquett.  The  number  of  current  requests  is  accumulated  over  time. 

12.  Xmil.  If  a message  can  be  transmitted  to  a process  requesting  a message 
then  the  number  of  messages  in  the  queue  and  the  number  of  current 
requests  are  each  accumulated  over  time. 

13.  F.ndxmit.  After  a message  has  been  transmitted  the  time  is  recorded. 

14.  Rcreceive.  If  a process  had  been  waiting  to  send  a message  to  the  link, 
but  could  not,  due  to  the  link’s  queue  size  limit,  then  it  is  allowed  to 
continue.  The  number  of  processes  waiting  to  send  a message  is 
accumulated  over  time. 

The  activities  listed  cover  all  of  the  activity  of  a link.  Data  are  collected 
concerning  each  property  of  the  link  that  changes. 


V.B.3.  The  scheduler  and  sets  of  concurrent  processes 

The  function  of  this  set  of  data  collection  facilities  is  to  provide  information 
that  can  bo  used  to  infer  how  the  processes  interact  with  each  other  over  time.  One 
measure  is  the  average  number  of  active  processes.  Another  measure  is  concerned 
with  which  processes  are  active  at  the  same  time  as  other  processes.  Before  a 
process  becomes  active  it  is  scheduled  to  run  by  a process  scheduler.  Likewise, 
whenever  a process  becomes  inactive,  i.e.  is  waiting  for  some  reason,  the  scheduler  is 
notified. 

The  simulator  i»  used  to  estimate  the  effects  of  restricting  the  number  of 
processors.  This  restriction  brings  about  the  problem  of  the  schedulir  g of  processes 
when  more  processes  are  ready  to  run  than  there  are  processors  able  to  run  them. 
The  STEPPS  system  provides  the  following  scheduling  algorithms: 

1.  First-in-first-out  priority  (FIFO).  This  algorithm  schedules  the  process 
that  has  been  ready  for  the  longest  time.  When  several  processes  have 
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been  ready  for  the  same  length  of  time,  an  arbitrary  choice  Is  used  to 
determine  which  one  will  be  scheduled  first. 

2.  PROCESS  priority.  Each  process  can  be  assigned  a non-negative  priority. 
When  a choice  must  be  made  among  ready  processes,  then  the  process 
with  the  highest  priority  number  is  scheduled  first.  When  several 
processes  have  the  same  priority,  FIFO  is  used  to  resolve  the  choice. 

3.  LINK  priority.  Those  processes  that  are  ready  to  run  and  are  in  an  Input 
state  are  examined  first.  These  processes  are  req  it  sting  a message  from 
a link.  The  process  that  is  requesting  a message  from  the  link  containing 
the  most  messages  will  be  scheduled  first.  FIFO  is  used  to  resolve  any 
additional  choices, 

4.  PRLK  priority.  This  is  a combination  of  2 and  3.  After  these  processes 
with  the  highest  priority  are  selected,  then  the  process  requesting  a 
message  from  the  link  containing  the  largest  number  of  messages  is 
scheduled.  FIFO  is  used  to  resolve  any  addition^  choices. 

5.  LKPR  priority.  This  is  another  combination  of  3 and  2.  First  the 
processes  requesting  messages  from  the  links  containing  the  greatest 
number  of  messages  are  chosen.  Then  the  process  with  the  highest 
priority  is  chosen  among  them.  FIFO  is  used  to  resolve  any  additional 
choices. 

6.  RANDOM.  A random  choice  is  made  among  the  ready  processes. 

These  algorithms  were  chosen  for  inclusion  in  the  STEPPS  simulator  because 
they  are  simple  and  have  counterparts  in  real  systems.  The  last-in-first-out  algorithm 
was  rejected  because  it  does  not  adequately  represent  continued  processing. 
Modifications  to  the  STEPPS  system  that  could  include  different  scheduling  algorithms 
are  discussed  in  a later  section  of  this  chapter. 

The  data  collected  by  the  scheduler  are  listed  belcw: 

1.  Start.  A process  is  ready  to  run.  Accumulate,  over  time,  the  number  of 
active  processes  and  the  number  of  ready  processors. 

2.  Runaprocexs.  A process  is  activated.  Accumulate,  over  time,  the  number 
of  active  processes  and  the  number  of  ready  processes. 

3.  /lllactive.  A process  is  ready  to  run,  but  all  of  the  processors  are  active. 
Accumulate,  over  ime,  the  number  of  active  processes  and  the  number  of 
processes  ready  to  run. 

4.  Start proeext.  A process  is  about  to  become  active.  For  each  process  that 
is  running  collect  the  time.  This  represents  processes  starting  to  execute 
concurrently. 
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5.  Stopprocau.  A process  becomes  inactive.  For  each  process  that  is  still 
running  accumulate  the  time  that  the  two  processes  were  running 
together. 

6.  Dctchcdulc.  A process  has  become  inactive.  Accumulate,  over  time,  the 
number  of  active  processes  and  the  number  of  ready  processes. 

The  data  concerning  the  number  of  active  processes  are  always  collected,  but 
the  data  concerning  which  processes  are  active  concurrently  are  only  collected  when 
optionally  requested. 


V.B.4.  Analysis  of  the  data 

For  each  process  the  total  time  for  each  activity  and  wait  is  accumulated. 

Performance  expectation?  are  computed  for  each  of  the  following: 

Percentage  of  time  spent  computing  in  each  process  state. 

Percentage  of  time  spent  waiting  to  exclusively  access  a link  for  each 
state. 

Percentage  of  time  spent  waiting  until  the  link  was  ready  to  acknowledge 
access  for  each  port. 

Percentage  of  time  each  state  waited  until  the  link  could  complete  the 
required  I/O  operation. 

Percentage  of  *ime  spent  performing  the  I/O  operation  for  each  state. 

Percentage  of  time  the  process  was  ready  to  run  but  had  to  wait  to  bo 
scheduled. 

For  each  link  the  following  performance  expectations  are  computed: 

The  percentage  of  time  the  link  was  active,  inactive,  and  restarting. 

The  percentage  of  accesses  required  for  the  link  to  restart. 

The  expected  time  between  link  accesses,  between  Input  port  accesses, 
and  between  output  port  accesses. 

The  expected  queue  length. 

The  expected  number  of  processes  waiting  to  send  a message  to  the  link. 
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The  expected  number  of  processes  waiting  to  receive  massages  from  the 
‘Ink. 

The  analysis  of  the  schedule  data  is  used  to  compute: 

The  expected  number  of  active  processors. 

The  expected  number  of  processes  that  must  wait  to  be  scheduled  to  run. 

The  fraction  of  time  each  process  computes  concurrently  with  each  other 
process. 

Answers  to  the  questions  pi  isented  in  the  first  section  of  this  chapter  are  fill 
available  from  this  analysis.  Estimates  are  available  concerning  all  of  the  activities  of  a 
process  and  a link.  Bottlenecks  in  the  system  occur  at  those  links  where  queue 
lengths  are  large  and  where  processes  are  forced  to  wait  for  reasons  other  than  the 
• completion  of  an  input  or  output  operation.  By  examining  the  number  of  active 
processors,  decisions  can  be  made  concerning  numbers  of  processors  needed  for  the 
program.  Data  concerning  the  working  set  of  processes  can  be  used  to  facilitate 
prescheduling  of  sets  of  processes.  Likewise  when  processes  are  known  not  to  run 
concurrently  It  is  possible  to  manage  data  resources  to  take  advantage  of  this 
occurrence. 

For  the  simulations  presented  in  Chapter  Hi,  a variety  of  the  STEPPS  simulator 
variables,  data  collection,  and  data  analysis  facilities  proved  useful.  The  Bliss/11 
experiment  emphasized  varying  the  number  of  processors  available  and  using  the 
alternate  scheduler  algorithms:  FIFO,  LINK,  and  RANDOM.  The  specific  data  collection 
and  analysis  facilities  that  were  the  most  useful  included: 
number  of  messages  into  and  out  of  each  link, 
expected  queue  lengths  at  each  link, 

expected  process  wait  time  at  each  link  and  process  ports,  and 
average  number  of  active  processors. 
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The  Hearsay  II  experiment  was  more  complex,  and  used  additional  STEPPS 

simulator  facilities.  The  "working  set  of  processes"  analysis  was  used  to  determine  the 

proper  number  of  Knowledge  Sources  to  reproduce.  Since  th?  overhead  associated 

with  this  facility  was  large,  it  was  not  used  beyond  the  system  tuning  simulations.  The 

other  facilities  that  were  utilized  during  the  simulations  were: 

link  queue  lengths  used  to  show  where  interference, 

percent  of  time  spent  in  process  states  used  to  observe  which  processes 
contributed  to  the  link  queue  lengths,  and 

average  number  of  active  processors. 


V.C.  The  implementation  of  the  STEPPS  system 

The  STEPPS  interactive  system  has  been  implemented  on  the  Digital  Equipment 
Corporation  PDP-10  computer.  It  is  constructed  using  the  Sail  [VanLehn  73]  and 
Bliss/10  [Wulf  71]  programming  languages.  These  languages  were  chosen  since  each 
contains  features  that  are  most  appropriate  for  its  use.  The  discrete  time  simulator 
uses  a modification  of  a package  of  Bliss/10  (hereafter  referred  to  as  Bliss)  programs 
called  POOMAS  (Poor  Man’s  Simula)  originally  written  by  A.  Lunde  [Lunde  71].  The 
STEPPS  system  consists  of  about  45,000  words  of  PDP-10  36-bit  word  memory.1. 

The  STEPPS  system  command  language  was  designed  with  user  convenience  in 
mind.  The  command  syntax  consists  of  three  types:  node  connection,  transition  matrix 
manipulation  and  keyword  commands.  Wherever  possible,  unique  abbreviations  are 
acceptable.  For  example,  ALPHA.l*-BETA.l  means  to  connect  port  ALPHA.I001  to  a 
uniquely  named  new  link  (say  Link003)  and  then  connect  this  new  link  to  port 
BETA.0001.  Another  example,  DIS  CON  ALPHA,  LINK003,  BETA.01  is  the  same  as 

^This  includes  about  10,000  words  for  a debugging  package  and  library. 
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DISPLAY  CONNECTIONS  ALPHA,  LINK003,  BETA.OOOl  which  displays  the  connections  to 
the  objects  requested.  Every  parameter  to  a STEPPS  model  can  be  displayed  and 
modified  by  one  or  more  commands.  An  annotated  protocol  of  examples  using  the 
STEPPS  system  is  presented  In  Appendix  B. 

The  interactive  portion  of  STEPPS  was  written  in  Sail  and  takes  advantage  of 
Sail’s  powerful  string  manipulation  and  input/output  facilities.  The  lexical  and  syntactic 
analyzers  for  the  STEPPS  commands  are  written  in  Sail.  The  data  structures 
representing  a model  are  maintained  by  a set  of  Bliss  programs.  The  Sail  program  that 
performs  the  interpretation  of  the  STEPPS  commands  is  recursive,  so  that  when  a 
command  to  LOAD  from  a PDP-10  file  is  given,  the  system  simply  calls  the  main 
interpret  program  recursively.  This  means  that  commands  in  files  can  cause  other  fiies 
to  be  loaded.  The  displays  of  the  STEPPS  model  components  are  in  the  same  form  as 
the  command  language.  Thus  the  display  of  the  STEPPS  components  can  be  sent  to  a 
file  and  later  read  in  as  a set  of  commands.  The  Sail  portion  of  the  system  acts  as  a 
front  end  to  the  Bliss  portion  of  the  system. 

The  Bliss  portion  of  STEPPS  contains  programs  which  create  and  manipulate  a 
representation  of  a STEPPS  model.  The  representation  consists  of  a complex  data 
structure  where  each  link  node  and  process  node  contains  pointers  to  other  nodes,  as 
in  the  directed  graph  representation  of  a program  model.  The  use  of  pointers  and 
complex  data  structures  is  one  of  two  reasons  for  choosing  Bliss  to  implement  the 
representation  of  a STEPPS  model.  The  other  reason  is  the  availability  of  the  POOMAS 
simulation  package  for  Bliss  programs. 

The  internal  data  structures  are  complex  since  the  STEPPS  system  allows  a 
wide  variety  of  manipulations  of  a model.  A process  is  created  when  it  is  first  used, 
either  to  define  a connection  between  a port  of  the  process  and  a link  or  to  create  a 
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transition  matrix  for  a port  of  the  process.  Subsequently,  additional  ports  can  be 
added  to  the  process,  new  connections  made,  and  changes  made  to  tho  transition 
matrix.  Whenever  a modification  that  affects  the  transition  matrix  occurs,  a validity 
test  is  performed  to  insure  that  the  matrix  contains  proper  probabilities  (i.e.,  with  rows 
summing  to  one).  This  prevents  improper  alteration  of  the  transition  matrix  and 
sometimes  prevents  the  removal  of  a port  of  a process.  A link  is  created  In  the  same 
manner  as  a process,  viz.  when  it  is  first  used  for  a connection  or  when  it  is  assigned 
attributes. 

The  model  simulator  is  constructed  from  three  types  of  POOMAS  simulator 
processes:  STEPPS  processes,  STEPPS  links,  and  the  STEPPS  schedules.  The 

operation  of  these  simulated  processes  has  been  described  earlier  (section  V.B).  There 
are  pointers  in  the  STEPPS  data  structures  that  go  from  the  simulation  representations 
to  the  STEPPS  renresentation  and  vice-versa.  This  facility  makes  It  possible  to 
examine  the  progress  of  a simuiation  and  later  continue  the  simulation.  The  data 
collection  facilities  are  localized  and  this  enables  ease  in  adding  to  or  modifying  any  of 
these  facilities.  1.  data  analyzer  functions  are  also  localized  which  also  makes  it  easy 
to  add  to  or  include  other  analysis  facilities. 

The  speed  of  the  simulator  is  measured  by  the  number  of  events  per  second. 
The  events  are:  link  access,  link  startup,  link  delay,  process  perform  I/O,  process  start 
computing,  and  process  stop  computing.  Other  states  of  a process  and  a link  do  not 
cause  the  simulator  to  schedule  an  event.  The  time  consumed  by  the  scheduler  is  not 
measured  in  terms  of  events,  but  is  included  as  the  overhead  for  process  scheduling. 
The  resulting  measured  speed  is  approximately  eighty  events  per  second.  An 
estimation  of  the  length  of  time  required  to  obtain  results  concerning  a model  depends 
on  the  complexity  of  the  model.  The  STEPPS  system  maintains  counts  of  the 
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occurrence  of  various  events  and  so  it  Is  possible  to  examine  whether  enough  events 
have  occurred  to  continue  or  discontinue  a simulation. 

The  remaining  major  component  of  the  STEPPS  system  Is  the  deadlock 
recognition  algorithm,  which  is  also  written  in  Bliss.  The  general  algorithm  has  been 
described  in  Chapter  IV.  The  technique  used  is  to  iterate  through  the  set  of  links  *nd 
apply  reductions  Rl,  R2  and  R3  to  each  process  attached  to  the  link.  The  links  and 
processes  attached  to  them  are  examined  repeatedly  until  none  of  the  reductions  is 
applicable.  Finally  reduction  R4  is  applied  to  remove  the  remaining  SOURCE/SINKS. 
Actually,  whenever  a SOURCE/SINK  is  identified  and  all  adjacent  ports  to  it  have  been 
removed,  the  SOURCE/SINK  is  removed  as  well  so  that  it  need  not  be  examined  on  each 
cycle  through  the  graph.*  In  addition,  once  the  last  connection  to  a link  Is  removed,  the 
link  is  also  removed.  Although  the  order  of  application  of  the  reductions  is 
unimportant,  as  far  as  the  ultimate  result  is  concerned,  the  following  is  the  order 
chosen  for  implementation,  and  reasons  for  choosing  this  order: 

1.  R2c  (remove  ports  attached  to  SOURCE/SINKS).  This  reduction  is  expected 
to  cause  the  largest  number  of  reductions  to  occur.  It  Is  also  an  easy 
condition  to  determine. 

2.  R2a  (remove  ports  of  the  same  type  and  processes  from  the  same  link). 
The  conditions  for  this  reduction  are  easy  to  determine  and  reduce  the 
number  of  ports  attached  to  the  link. 

3.  R2b  (remove  ports  of  different  type  and  same  process  from  same  link). 

4.  Rl  (combine  adjacent  processes). 

5.  R3  (combine  parallel  processes  attached  to  the  link).  This  reduction  Is  the 
one  most  likely  to  benefit  from  application  of  the  other  reductions. 

Since  each  reduction  removes  one  or  more  connections,  the  total  number  of 
reductions  is  at  most  the  same  as  tho  number  of  ports,  which  equals  the  number  of 


*The  algorithm  description  (Chapter  IV)  was  simplified  by  not  Including  this 
Implementation  alternative. 
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connections.  A more  interesting  measure  of  the  cost  of  the  reduction  algorithm  is  the 
number  of  ports  that  must  be  examined.  The  worst  case  would  be  one  successful 
removal  of  one  port  per  examination  of  the  ports.  If  there  are  N ports  in  a graph, 
then  the  algorithm  would  require  at  worst  N!  port  examinations.  A more  realistic 
estimate  should  be  based  on  the  successful  application  of  more  than  one  reduction  per 
pass  over  of  the  ports.  If  one  fourth  of  the  ports  are  removed  per  loop  through  the 
ports1,  then  the  total  number  of  examinations  required  is  approximately  4*N.  The 
reason  that  this  estimate  is  more  realistic  is  that  successful  application  of  a reduction 
at  the  beginning  of  a loop  through  the  ports  can  cause  the  application  of  a reduction 
that  might  not  have  occurred  before. 

The  STEPPS  system  was  designed  so  that  it  would  be  possible  to  include 
analysis  programs  that  are  not  original  components  of  the  STEPPS  system.  An  example 
might  be  to  use  an  analysis  of  semi-Markov  processes.  The  STEPPS  system  will  allow 
such  a program  to  be  written  in  FORTRAN,  Sail  or  Bliss  and  later  included  with  the 
STEPPS  system.  The  method  is  to  link  the  new  program  with  the  STEPPS  system  and 
then  apply  the  new  program  to  a STEPPS  process.  The  STEPPS  system  will  convert 
the  internal  representation  of  a STEPPS  transition  matrix  to  the  form  expected  by  a 
FORTRAN  or  Sail  program  (i.e.,  a matrix)  and  then  perform  a call  of  the  FORTRAN,  Sail 
or  Bliss  program.  The  structure  of  the  transition  matrix  is  defined  to  be  the  same  as 
displayed  by  the  STEPPS  "DISPLAY"  command.  Another  type  of  analysis  that  might  be 
written  externally  to  the  STEPPS  system  is  the  analysis  of  a connection  matrix 
representing  the  entire  STEPPS  model.  For  this  situation,  a matrix  will  be  formed  to 
represent  the  connections  among  the  processes  and  the  application  of  the  external 
analysis  program  would  be  performed  on  the  representative  connection  matrix. 


*AII  tested  cases  resulted  in  even  greater  reductions  than  this. 


V.C  The  implementation  of  the  STEPPS  system 


V-15 


Even  though  the  STEPPS  system  was  designed  to  accommodate  externally 
defined  analyses,  the  easiest  way  to  include  new  features  Into  the  STEPPS  system 
would  be  to  add  them  to  the  system  itself.  This  task  should  not  be  difficult  for  a Bliss 
programmer,  since  the  system  Is  well  organized  into  many  small  subroutines,  and  is 
Internally  well-documented.  Very  few  of  the  routines  in  either  the  Sail  portion  of 
STEPPS  or  the  Bliss  portion  are  more  than  fifteen  lines  long,  so  their  complexity  Is 
kept  to  a minimum.  In  addition,  the  system  Includes  a large  number  of  debugging 
facilities.  The  removal  of  the  debugging  facilities  would  probably  decrease  the  size  of 
the  STEPPS  system  by  about  tweive  thousand  words  (this  includes  eight  thousand 
words  of  non-STEPPS  debugging  tools). 

The  STEPPS  system,  as  constructed,  is  realiy  a prototype  for  tools  that  should 
be  available  to  a systems  designer.  As  such,  a number  of  lessons  were  learned 
concerning  the  systems  implementation.  One  criterion  adhered  to  was  the  emphasis  on 
man-machine  interaction  convenience.  Many  times  the  ease  of  using  simple,  yet 
descriptive  commands  made  the  STEPPS  system  appear  elegant  even  when  features 
were  being  debugged  In  a successor  system,  even  greater  emphasis  should  be  placed 
on  the  man-machine  interaction  than  in  the  prototype  system.  The  amount  of  extra 
code  and  nominal  extra  processing  time  are  weli  worth  the  user  convenience.  The 
STEPPS  structure  was  noted  above  as  being  well  organized,  which  also  must  be 
emphasized  as  a valuable  lesson.  It  was  often  found  that  disciplined  programming 
style  used  and  appropriate  testing  and  debugging  aids  constructed  greatly  assisted  In 
the  overall  system  development. 

There  were  implementation  drawbacks  in  addition  to  the  constructive  lessons. 
The  STEPPS  system  uses  a set  of  fairly  complex  data  structures.  It  was  not  estimated 
during  the  system  design  that  these  structures  could  grow  rapidly  (eg.  whenever  a 
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new  port  was  added).  Thus  during  the  application  of  the  STEPPS  system  to  the 
examples  of  Chapter  III,  the  data  structure  had  to  be  redesigned  and  rebuilt. 
Fortunately  the  previously  mentioned  programming  discipline  used  made  th-s  aomewhat 
painless  in  terms  of  propagating  errors  (some  "information  hiding"  had  been  used).  It 
must  still  be  observed  that  the  data  structure  problem  is  not  solved,  but  could  be  if 
the  'next  version  of  STEPPS  handled  simulations  and  model  structures  in  a fashion 

different  from  the  current  system. 

A similar  improvement  can  ba  mada  to  the  STEPPS  system  by  constructing  a 
discrata  avent  simulator  tailorad  to  tha  STEPPS  modal.  Tha  POOMAS  simulator  was 
usad  tor  convenience,  but  it  contains  unneeded  features  that  add  to  the  STEPPS 
syslam  size  and  add  to  the  time  required  for  a STEPPS  simulation.  Thus  tha  simulator 
should  be  optimized  for  STEPPS  simulations. 


Chapter  VI 
Summary 


this  thesis,  the  problem  of  designing  Programs  lor  .synchronous 
multiprocessor  computers  h.s  been  eddressed  A particular  design  philosophy  hes 

phasized  consisting  of  predicting  the  implications  o.  design  decisions  et  early 

stages  during  multiprocess  program  design  and  development.  The  thesis  presents 
design  .cols  consisting  ol  a model  for  describing  the  decomposition  of  a program  into 
asynchronous,  concurrently  executable  subparts,  an  analysis  algorithm  to  determine 
whether  a mode,  contains  a deadlock,  an  interactive  system  for  manipulating  a mode, 
representation,  and  a simulation  system  for  predicting  the  performance  of  program 

structure  under  a variety  of  scheduling  algorithms. 

These  tools  (called  STEPPS)  have  been  used  to  model  possible  program 

structures  with  fin.  granularity  (as  with  Petri  nets)  end  a.  a functional  level.  Potential 
structural  problems  may  be  identified  and  a program  restructured  before  an 

d.  in  a poorly  structured  program  Two  - nerimen.s  have  been 

performed  to  predict  performance  impiic.tions  of  multiprocess  structures.  In  one 
experiment,  using  a STEPPS  model  and  the  STEPPS  system,  the  Implications  of 

restricting  the  numbers  liable  processors  and  using  different  scheduling 

algorithms  were  examined,  and  the  effect  of  using  alternate  program  structures  was 
explored.  In  the  other  experiment  it  was  shown  that,  when  a multiprocess  program 
under  development  is  sufficiently  instrumented,  the  STEPPS  model  and  system  can  be 

used  to  help  tune  the  program’s  structure. 

Thus  it  has  been  demonstrated  that  the  STEPPS  model  and  the  STEPPS  system 

do  help  to  accomplish  a well  structured  design. 
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VI.A.  Designing  Programs  for  Multiprocessor  Computers 

The  past  few  years  have  seen  the  advent  of  multiprocessor  computers  (See 
Chapter  I),  and  more  are  being  developed  as  hardware  costs  decrease  through 
technological  advancement.  In  addition,  since  microprocessors  and  mini-computers  ere 
being  connected  to  comprise  new  multiprocessor  networks,  the  need  has  arisen  to 
design  programs  to  utilize  these  multiprocessor  computers.  It  is  now  recognized  that 
the  total  cost  of  a computer  system  has  become  based  more  on  software  costs  than  on 
hardware  costs  [Boehm  73].  Through  proper  software  design  the  costs  for  testing, 
coding,  debugging,  redesigning,  maintaining,  and  extending  software  can  be  better 
controlled,  thereby  decreasing  the  total  cost  of  the  computer  system.  The  software 
design  tools  discussed  within  this  thesis  are  particularly  valuable  due  to  the  current 
interest  in  multiprocessor  programs. 

The  approach  taken  for  understanding  how  multiprocess  program  components 
interact  is  based  on  the  interprocess  communication  structure.  It  is  at  this  level  that 
an  abstraction  can  often  be  made  for  a system.  Central  to  the  abstraction  is  the 
decomposition  of  the  total  system  into  a suitable  set  of  functional  components. 
Consequently,  understanding  how  a multiprocessing  system  works  can  be  aided  by 
understanding  how  the  components  of  the  system  communicate. 

Several  tools  have  already  been  developed  as  aids  to  the  design  and  analysis 
of  multiprocessor  systems.  Of  these  tools,  modeling  techniques  used  include  Petri-nets 
[Petri  62],  the  UCLA  model  [Estrin  63],  and  queueing  theory  models  [Kleinrock  75]. 
They  have  been  used  to  represent  interprocess  control  and  data  flow,  program 
validity,  bottleneck  identification,  and  program  determinism.  However,  these  models 
suffer  from  being  so  complex  or  abstract  as  to  not  really  represent  the  functional 
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aspects  of  the  total  system.  In  addition,  these  models  often  have  been  difficult  to 
analyze.  Another  approach  was  taken  by  Riddle  [Riddle  72],  who  combined  a functional 
structure  with  program-like  descriptions  of  individual  processes.  This  model  was  an 
improvement  in  understanding  overaii  system  structure,  but  it  stiii  suffered  from 
requiring  programming  detail  to  describe  a process's  interactions.  Similarly  due  to  its 
program-iike  ature  and  to  its  complex  algebraic  form,  Riddle’s  models  are  difficult  to 
analyze.  Another  type  of  tool,  simulation,  has  proven  to  be  a valuable  approach  to 
analyzing  system  design.  However,  simulations  must  be  individually  programmed  in  a 
suitable  programming  language  (e.g.  GPSS  or  SIMULA).  Simulation  models  provide  much 
useful  information,  but  like  most  programs  they  are  difficult  to  construct  and  (often)  to 
modify. 

STEPPS  consists  of  a set  of  design  tools  that  combire  several  of  the 
advantages  of  the  abovementioned  tools  with  a new  Idea  felt  to  be  natural  for  system 
design.  The  major  new  concept  is  that  processes  comprising  a muitiprocess  program 
are  abstracted  as  operating  in  a probabilistic  manner  with  respect  to  their 
interprocess  communication  activities.  The  STEPPS  system  was  designed  to  avoid  the 
dual  problems  of  very  fine  required  detail  and  reprogramming  for  examining 
implications  of  alternate  multiprocess  program  structuring.  The  other  features  of  the 
STEPPS  tools  comprise  an  interactive  system  used  to  simulate,  manipulate,  and  analyze 
STEPPS  program  modeis. 

VI.A.l.  The  STEPPS  ayatem 

A STEPPS  program  modei  is  a directed  graph  consisting  of  two  types  of  nodes: 
process  nodes  and  link  nodes.  Communication  among  nodes  In  the  model  is 
represented  by  the  movement  of  message  tokens.  The  operation  of  the  entire  modei  is 
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defined  in  terms  of  the  individual  operation  process  nodes.  A process  can  request 
messages  from  and  send  messages  to  link  nodes.  The  sequence  of  operations  of  each 
process  is  defined  similarly  to  the  operation  of  a semi-Markov  process.  That  is,  both  a 
probability  and  a computation  time  are  associated  with  each  possible  successive 
process  operation  (request  a message  from  a link  or  send  a message  to  a link). 

The  STEPPS  model  is  more  expressive  in  terms  of  modularity  and  potential 
activity  than  Petri-net  like  models.  Yet  the  STEPPS  model  abstracts  many  of  the 
expressive  details  provided  in  programming  languages  and  programming-like  models. 
The  model  is  at  an  abstraction  level  that  emphasizes  both  interprocess  communications 
and  internal  process  complexity  based  on  probabilities  and  timing.  In  Chapter  I it  was 
demonstrated  that  the  STEPPS  model  could  incorporate  both  the  Petri-net  model  and 
the  UCLA  model.  In  Chapter  III,  more  natural  examples  were  also  demonstrated  using 
STEPPS:  fork/join,  subroutines,  probabilistic  server  processes,  P/V,  and  reader/writer. 
More  importantly,  two  non-toy,  more  complete  examples  were  modeled  and  simulated: 
Bliss/1 1 and  Hearsay  II. 

The  STEPPS  simulator,  which  is  invoked  from  the  STEPPS  system,  cars  be 
configured  to  represent  a variety  of  execution  environments.  These  environments  are 
defined  in  terms  of  the  number  of  processors  available  and  scheduling  algorithms  used 
when  a scheduling  choice  is  required.  Data  are  collected  and  analyzed  to  predict  such 
aspects  of  a modeled  program’s  performance  as  queue  lengths,  rates  of  data  flow  at 
links,  process  activity  and  parallelism.  Some  measures  of  parallelism  of  interest  to 
STEPPS  are  those  concerning  the  average  number  of  active  processors  and  the 
working  sets  of  processes. 

The  STEPPS  interactive  system  was  designed  to  facilitate  rnsn-machine 
interaction.  Some  features  of  the  system  are.  commands  for  creating  and  manipulating 
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STEPPS  model  representations!  commands  for  saving  a mocjpl  or  parts  of  a model  for 
later  retrieval;  commands  for  displaying  all  parameters  of  a model  and  simulation; 
abbreviations  for  most  commands;  and  automatic  assignment  of  default  values  to 
unspecified  model  and  simulation  parameters. 

The  STEPPS  model  can  be  automatically  analyzed  to  determine  the  existence  of 
a deadlocK  possibility.  This  analysis  (detailed  in  Chapter  IV)  is  performed  by 
Iteratively  applying  a sequence  of  graph  reductions  to  a STEPPS  program  model  until 
no  further  reduction  is  applicable.  The  reductions,  which  are  applied  when  certain 
constraints  are  satisfied,  are:  combine  two  adjacent  processes  intc  one;  eliminate 
states  or  combine  two  states  to  be  one  state  of  a process;  combine  two  processes  that 
are  in-parallel;  and  eliminate  processes  that  can  perform  only  one  operation. 

It  has  been  demonstrated  that  each  reduction  preserves  the  possible 
interprocess  communication  among  those  processes  not  involved  in  the  reduction.  If  as 
the  result  of  the  completion  of  all  possible  applications  of  the  reductions  there  are  no 
nodes  remaining  then  the  original  representation  was  that  of  a structure  with  no 
deadlocks.  Otherwise  the  original  structure  contained  a non-zero  probability  of  a 
deadlock.  The  complete  reduction  algorithm  has  been  Implemented  as  part  of  the 
STEPPS  system. 

VLB.  Experiments  end  Results 

Two  non-trivlal  experimental  applications  were  conducted  to  validate  the 
usefulness  and  significance  of  the  STEPPS  tools.  The  Bliss/11  compiler  structure  [Wulf 
75a]  was  studied,  modeled,  and  analyzed  for  reconstruction  on  a multiprocessor  based 
upon  a design  slmiler  to  its  sequential  structure.  The  Hearsay  II  multiprocess  speech 
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understanding  system  [Lesser  74,  Fennell  75b]  was  analyzed  using  STEPPS  to  help 
explain  a phenomenon  of  interprocess  interference  [Fennell  75a,  75b]. 


VI.B.l.  The  STEPPS  Bliss/11  application 

The  STEPPS  Bliss/11  application,  presented  in  Chapter  111,  was  performed  to 
predict  potential  throughput  increases  if  the  compiler  structure  were  moved  to  a 
multiprocess  organizational  environment.  Using  a multiprocess  structure,  based  upon 
the  compiler’s  pipeline  organization  [Wulf  75a],  it  was  found  that  throughput  co"id 
increase  approximately  3.5  times  over  throughout  achieved  with  a single  process 
structure.  In  addition,  by  using  the  STEPPS  simulator  features  to  restrict  the  number 
of  available  processors  and  schedule  ready  processes  on  them,  it  was  found  that  most 
of  the  throughput  increase  could  be  attained  by  using  two  thirds  o'  the  potential 
number  of  processors.  Furthermore,  it  was  found  that  varv.r v scheduling  s gorithms 
available  to  the  STEPPS  system  (i.e.  FIFO,  most  waiting  requests,  and  random)  did  not 

appreciably  affect  the  throughput  rate. 

The  Bliss/11  structure  was  augmented  to  examine  i .sequences  of 

providing  duplicate  processes  for  some  of  the  Bliss  .ompiler  components.  The 
results  of  the  simulations  demonstrated  that  there  would  bo  an  increase  in  throughput, 
but  that  potentially  it  was  not  large  (about  4 times  sequential).  These  results  also 
indicated  that  the  necessarily  sequential  lexical  analysis  stage  of  the  compiler  is  a 
significant  bottleneck  preventing  compilation  speedups.  Again  it  was  observed  that 
most  possible  throughput  was  reached  by  using  about  two  thirds  of  the  potential 
number  of  processors. 

A systems  designer  embarking  on  designing  a multir  sssor  Bliss/11 
implementation  can  use  these  results  to  aid  in  determining  where  to  concentrate 
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efforts.  It  was  predicted  that  the  crucial  part  of  the  compiler  process  structure  was 
the  purely  sequential  lexical/syntactic  analysis  component.  Hence  this  component 
should  receive  attention  to  optimize  its  processing.  Alternatively,  ‘t  could  be 
concluded  that  there  is  processing  time  available  to  perform  more  sophisticated  and 
time  consuming  semantic  optimizations  since  the  lexical/syntactic  analysis  uses  the  bulk 
of  the  compiling  process.  Another  conclusion  for  the  systems  designer  is  that  there 
does  not  appear  to  be  a large  gain  in  processing  achieved  by  designing  a compiler  to 
dedicate  a processor  to  each  process.  Instead  it  appears  that  a design  based  upon 
fewer  processors  than  the  potential  number  of  processes  can  achieve  almost  as  good  a 
throughput  rate. 

VI.B.2.  The  STEPPS  Hearaay  II  application 

The  STEPPS  Hearsay  II  application,  presented  in  Chapter  III,  demonstrated  that 
STEPPS  can  be  used  to  model  abstractly  a real  multiprocess  program  structure;  to 
reproduce  an  interesting  phenomenon  of  that  program  structure;  and  consequently  to 
indicate  whether  the  cause  of  the  phenomenon  is  at  the  structural  level  abstracted  by 
the  STEPPS  model.  The  Hearsay  II  Speech  Understanding  System  (HSII)  [Lesser  74, 
Fennell  75b]  has  been  designed  to  utilize  a variety  of  analysis  sources  to  solve  the 
problem  of  understanding  human  speech  for  the  performance  of  a task.  The  task  has 
been  functionally  decomposed  In  a data  driven  structure  so  that  individual  components 
of  the  understanding  process  can  be  performed  concurrently  in  a closely-coupled 
multiprocessor  environment. 

The  STEPPS  model  was  used  to  represent  the  operation  of  the  Individual 
processing  components  of  the  HSII  system:  the  precondition  (PC)  processes  and  the 
knowledge  tource  (KS)  processes.  In  addition,  the  data  base  (DB)  blackboard  was 
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modeled  as  a set  of  synchronization  locks.  This  model  is  an  abstraction  based  upon  an 
analysis  of  the  HSU  structure  and  upor  <ata  provided  as  a result  of  instrumentation 
incorporated  into  the  HSII  system  J HSU  designers  and  implementers.  The 

specific  data  provided  were  obtained  from  executing  HSII  in  a sequential  (single 
processor)  manner. 

The  STEPPS  HSII  model  is  probabilistic  in  nature  and  is  based  on  potential 
communication  activities.  The  three  types  of  communication  activities  emphasized  are: 
initiate  a precondition  process,  access  the  data  base,  and  initiate  a knowledge  source 
process.  The  data  provided  from  the  implemented  prototype  HSII  system  were 
analyzed  to  provide  estimates  for  choices  of  precondition  processing  activity.  The 
data  were  also  used  to  determine  STEPPS  HSII  process  computation  times  and 
probabilities  for  accessing  portions  of  tho  data  base.  Probabilities  (based  on  the 
provided  data)  also  are  used  to  indicate  a precondition’s  potential  initiation  of  a 
knowledge  source  process. 

The  accessing  of  the  HSII  data  base  blackboard  is  organized  as  a hierarchical 
(lock/unlock)  synchronization  structure  to  maintain  data  integrity  and  to  prevent 
processing  deadlocks.  Fennell  [Fennell  75a,  75b]  performed  simulations  of  a 
multiprocessor  HSII  system  and  discovered  that  locking  interference  placed  a 
substantial  overhead  on  the  HSII  throughput  rate  as  measured  by  the  average  number 
of  active  processors.  Specifically,  he  found  that  the  interference  decreased  processing 
by  about  two  thirds,  but  he  did  not  explain  the  reason  for  this  phenomenon. 

The  STEPPS  system  was  proposed  as  a tool  to  determine  whether  the  locking 
Interference  phenomenon  occurred  due  to  locking  of  a small  number  of  data  base 
segments  or  whether  the  problem  was  more  complex.  An  implication  might  be  that  the 
locking  hierarchy  mechanism  might  be  made  simpler,  i.e.  less  finely  grained. 
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Simulations  were  performed,  based  on  the  STEPPS  HSI1  model,  varying  the  number  of 
possible  data  base  regions  that  could  be  locked.  In  addition,  the  model  was  simulated 
with  locking  turned  off  (as  in  Fennell’s  simulations).  The  result  was  that  the  average 
active  number  of  processors  with  and  without  locking,  using  the  STEPPS  simulations, 

corresponded  to  Fennell’s  results. 

This  result  is  significant  In  that  the  locking  phenomenon  was  reproduced  while 
based  on  a simple  probabilistic  communications  model.  Since  the  probabilities  used 
were  Uken  from  a sequential  execution  of  the  HSII  system,  the  interprocess 
cooperation  did  not  seem  to  affect  greatly  the  locking  interference  problem.  The 
hypothesis  that  the  interference  was  due  to  locking  of  a small  number  of  regions  was 

supported  by  the  simulation  statistical  results. 

The  STEPPS  system  was  demonstrated  as  providing  the  HSII  system  designers 
with  a tool  for  modeling  communications  structures.  It  has  provided  the  HSII  designers 
some  interesting  information,  and  through  modification  of  the  computation  times, 
probabilities,  and  model  structure  it  should  be  able  to  provide  more  Information.  Thus 
the  STEPPS  HSII  model  should  be  a useful  framework  for  exploring  the  effects  of 
• possible  design  changes  suitable  to  the  model’s  structure. 

VI.C.  Future  research  and  refinements  to  STEPPS 

The  STEPPS  model  and  simulator  are  based  on  a fixed  Interprocess 
communication  pattern  and  a fixed  number  of  processes.  These  restrictions  were 
judged  to  be  necessary  when  the  deadlock  detection  algorithm  was  designed.  It  is 
unknown  whether  dynamic  creation  and  deletion  of  processes  will  still  allow  the 
application  of  a deadlock  detection  algorithm.  It  may  be  necessary  to  restrict  the 
types  of  operations  and  connections  that  dynamically  created  processes  can  have. 
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Several  other  generalizations  of  interprocess  communication  may  be  considered 
as  modifications  to  the  model.  Hierarchical  and  interrupt  relations  are  multiprocess 
relations  that  it  is  not  now  possible  to  model  using  STEPPS,  however,  It  may  be 

possible  to  modify  the  model  to  include  such  structures. 

A limitation  of  the  STEPPS  model  discovered  during  applications  of  the  model 
was  the  introduction  of  extra  modeling  complexity  required  to  model  some  possibly 
interesting  program  communication  structures.  For  example,  the  STEPPS  reader/writer 
model  demonstrated  that  the  STEPPS  model  only  worked  with  a finite  number  of 
readers/writers.  This  is  a symptom  of  processes’  actions  not  being  determined  by 
information  carried  by  the  message  tokens  (e  g.  tagging,  sender,  return-request,  etc.). 
The  inclusion  of  actions  (other  than  timing)  based  on  message  contents  would  add 
program-like  complexity  to  a process  model  and  would  also  discount  the  present 
formulation  of  the  deadlock  detection  algorithm.  Any  extension  to  the  STEPPS  model 
based  on  including  message  information  may  not  prove  fruitful  due  to  its  own  form  of 

added  complexity. 

Areas  of  deadlock  analysis  beyond  the  detection  algorithm  would  be  the 
identification  of  cause(s)  and  the  prediction  of  the  probability  of  a deadlock  over  time, 
events,  or  some  other  measure.  The  STEPPS  system  can  be  used  to  trace  the 
application  of  the  deadlock  detection  algorithm  and  to  display  a resulting  irreducible 
graph.  Studying  this  trace  and  the  resulting  graph  has  proven  useful  in  discovering 
the  cause  of  deadlocks  while  testing  the  STEPPS  system,  and  It  may  be  possible  to 
create  an  algorithm  for  this  process. 

The  STEPPS  interactive  system  uses  simple  linear  displays  of  a STEPPS  model. 
It  may  be  possible  to  create  more  natural  displays  of  the  directed  graph 
representation  of  a model.  This  problem  may  be  difficult  because  a model  has  no 

defined  root,  terminal  or  topology. 
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As  the  STEPPS  system  was  applied  to  the  examples  presented  in  Appendix  B, 
features  were  added  to  enhance  the  convenient  use  of  the  system.  It  Is  possible  that 
future  experience  using  STEPPS  will  indicate  other  Improvements.  Some  extensions 
that  might  be  useful  are: 

1.  Compute  time  between  port  activations  need  not  be  fixed!  Instead  it  can 
come  from  a definable  density  function.  This  Is  closer  to  the  actual 
definition  of  compute  times  for  a semi-Markov  process. 

2.  The  ability  to  identify  a group  of  nodes  and  copy  them  in  one  operation 
may  be  used  to  organize  similar  subparts  of  a large  structure.  It  Is 
already  possible  to  copy  single  nodes  and  transitions  from  a process 
state. 

3.  The  state  of  a simulation  could  be  saved  for  future  continuation. 

The  STEPPS  system  has  been  shown  to  be  useful  in  the  design  and  analysis  of 
two  muitiprocess  programs,  viz.  Bliss/11  and  Hearsay  II.  Now  that  the  author  has 
tested  and  debugg  *<  fhese  examples  on  the  STEPPS  system,  others  should  use  STEPPS 
or  a system  very  muc.i  iike  it  in  the  complete  design  and  construction  of  multiprocess 
programs.  STEPPS  Is  intended  as  a useful  group  of  design  tools  and  should  be  used 
for  that  purpose. 

As  experience  Is  gained  in  using  the  STEPPS  model,  more  techniques  such  as 
those  presented  In  the  beginning  of  Chapter  III  can  be  ere  * jd.  For  example,  other 
synchronization  techniques  may  be  designed,  in  addition  to  the  PV  and  reader/writer 
examples  shown. 

Some  problems  which  might  be  constructed  for  a multiprocessor  and  which 
could  use  STEPPS  are:  a multiprocess  compiler  Implementation,  sort  and  search 
programs,  theorem  provers,  data  pipelines  (with  and  without  feedback),  and  data  base 
management  programs. 
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VI.O.  Conclusions 

As  noted  in  Chapter  I,  several  multiprocessor  computers  are  available  and/or 
being  developed.  In  particular,  C.mmp  [Wylf  75b]  has  reached  a stage  of  maturity 
where  several  multiprocess  programs  are  being  designed  and  developed  for 
Implementation  on  it.  The  tools  presented  in  this  thesis  research  should  be  useful  to 
those  designing  programs  for  C.mmp  or  for  any  communicating  multiprocess  program 
environment. 

By  using  an  interactive  system,  a program  designer  can  create  a model  of  his 
program  and  discover  a variety  of  Implications  of  his  design  decisions.  The  STEPPS 
• system  is  most  appropriate  for  this  type  of  exploration  of  a program  structure  space. 
STEPPS  provides  analysis  tools  and  simulation  tools  in  one  Interactive  system.  Neither 
unique  model  analysis  nor  unique  simulation  models  need  to  be  developed  when  the 
STEPPS  system  is  used. 

A second  advantage  of  jsing  the  STEPP3  system  concerns  the  ability  to  predict 
performance  changes  in  a running  system  before  making  modifications  to  the  system. 
This  type  of  design  decision  is  important  for  determining  where  to  direct  efforts  to 
improve  a system’s  performance.  The  overall  structure  of  a program  Is  no  longer  the 
only  issue;  instead  considerations  include  the  sensitivity  of  a program’s  performance  to 
modifications  of  the  orogram  structure  and  changes  In  modeled  probability  and  time 
parameters. 

The  major  advantage  of  the  STEPPS  system  over  other  systems  analysis  tools 
and  techniques  Is  that  the  STEPPS  system  automates  the  production  of  results. 
Furthermore,  if  methods  of  analysis  that  are  not  already  available  within  STEPPS  are  of 
interest,  it  may  be  a simple  task  to  Include  these  other  methods  with  the  STEPPS 
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system.  Finally,  Ihe  Bliss/U  example  demonstrated  that  STEPPS  can  be  used  to 
prov.de  pertormance  predictions  quickly  lor  a multiprocess  program  design,  and  the 
Hearsay  11  example  demonstrated  that  decisions  may  be  mad.  concerning  modification 
an  ongoing  system,  based  upon  a simulation  o.  a STEPPS  model  ot  that  system. 
Thus  we  conclude  that  the  STEPPS  interactive  system  is  a useful  tool  for  the  des.gn 
and  analysis  of  multiprocess  program  structure. 
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APPENDIX  A 

STEPPS  System  Manual 


This  appendix  contains  a complete  description  of  the  STEPPS  system  facilities 
and  their  use.  For  clarity,  more  than  precision,  BNF  notation  Is  used  to  describe  the 
command  syntax. 

A.l.  Introduction 

The  STEPPS  system  is  an  interactive  system  for  use  in  modeling  and  simulating 
multiprocess  programs.  The  following  services  and  facilities  are  provided: 

Creation  and  manipulation  of  models 

Displays  of  all  model  constituents 

Analysis  for  well-formed  and  deadlock-free  model 

Simulation  and  data  collection 

Display  of  simulation  parameters,  state,  collected  data,  and  statistics 
Model  description  saving  and  retrieving 

The  three  distinctive  types  of  commands  are:  set  model  connections,  define 
transition  matrices,  and  keyword.  These  distinctions  exist  for  user  syntactic 
convenience. 

The  model  connection  command  is  recognized  by  its  inclusion  of  at  least  one 
and  is  used  to  connect  model  nodes.  The  transition  •*'»trix  command  :s  recognized 
by  its  inclusion  of  one  "-"T  The  keyword  commands  begin  with  a command  keyword 
and  never  contain  V"  or 

'^The  one  exception  to  this  will  be  explained. 
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Names  of  objects,  processes  or  links  are  defined  as  in  most  languages  with  the 

restriction  that  a maximum  of  10  characters  can  be  uniquely  distinguished. 

<name>  <letter>  | <name><letter>  | <name><digit> 

<letter>  A|B|C|D|E|F|G|H|I|J|K|L|M|N|0|P|Q|R|S|T|U|V|W|X|Y|Z|*|$!T 

<digit>  0|1|2|3|4|5|6|7|8|9 

<process  name>  <name> 

<link  name>::-  <namc> 

While  a'l  input  to  the  STEPPS  system  may  be  either  up*-:r  or  lower  case 
letters,  lower  case  is  automatically  converted  to  upper  cfse.  Thus  lower  case  names 
can  be  used  for  convenience,  but  they  are  indistinguishable  from  upper  case  names 
with  the  same  characters  (and  order). 

Process  ports  are  identified  by  the  process  name,  the  port  type,  and  the  port 
number.  The  usual  definition  is: 

<port  name>::«  <process  name>.<port  type><pOrt  number> 

<port  type>::-  I | 0 

<port  number>  positive  integer  less  than  1000 

<untyped  port  name>  <process  name>.<port  number> 

<port  id>  <port  type><port  number> 

Some  connection  commands  allow  abbreviations  for  <port  names>  using 
<untyped  port  name>  and  context  for  definition. 

Keyword  commands  begin  with  a keyword  and  parameters  follow  on  the  same 
line.  The  actual  syntax  of  the  keyword  parameters  is  dependent  on  the  particular 
keyword.  However,  consistency  among  some  keyword  parameters  is  that  keyword 
subparameters  are  usually  order  independent.  Also,  keyword  abbreviations  and 
parameter-subkeyword-abbreviations  can  be  used  by  entering  unique  initial  character 
strings.  Thus  E may  be  used  for  EXIT,  but  DI  must  be  used  for  DISPLAY  since  DENSITY 
is  also  a command. 

Spaces  (at  least  one)  are  used  as  separators  between  keywords  and 
parameters.  In  some  situations  a comma  may  be  used  instead  of  a space,  but  a space 
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can  not  be  used  in  place  of  a comma.  Spaces  may  be  freely  inserted  around  separator 

characters  Comments  can  appear  on  any  line  by  placing  an  T which  caises 

everything  to  its  right  to  be  ignored.  Line  continuation  is  used  by  placing  a as  the 

last  non-comment  character  on  a line.  Thus, 

D1S-!  Ost  line  <cr> 

PLAY-<cr> 

GRAPH  ! 3rd  line<cr> 
is  a legal  command*. 

Each  parameter  that  can  be  set  by  commands  has  a defined  default  value. 
These  default  values  will  be  presented  in  the  command  descriptions. 

For  the  BNF  syntax  descriptions,  two  notational  assumptions  will  be  used.  A 
syntax  root,  a list  definition,  and  a command  will  all  be  assumed.  Thus  the  following 
describes  the  missing  syntax: 

<STEPPS  commands>  <connect  nodes>  | <define  matrix> 

| <keyword  command> 

<keyword  command>  <"lst"  keyword  command>  | <”2nd"  keyword  command> 

| <"3rd"  keyword  command>  . . . 

<y-list>  <y>  I <y-list>,  <y> 

<x  parami5*  <x  param>  | <x  parami>  <x  param> 

A.2.  Model  Creation 

A model  is  created  by  defining  the  connections  among  its  nodes,  its  transition 
matrix  values,  and  its  link  attributes.  A model  can  be  given  a name  by  using  the 
command  MODEL  This  name  is  used  when  displaying  the  model  components,  and  when 
saving  and  retrieving  the  model  description. 


*<cr>  means  carriage  .eturn. 
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A.2.i.  Connecting  nodes 

The  following  is  the  syntax  for  connecting  nodes: 

<connect  nodes>  <port  connection>  | <link  connection> 

<P°rt  connection^:  <type!ess  port  list>  *-  <connect  nodes> 

<link  connection>  <link  name>  «-  <port  connection> 

<typeless  port>  <process  name>.<port  number> 

<pOrt  number>  non-negative  integer  less  than  1000 

A connection  between  an  input  port  and  a link  is  represented  by:  the  input 

port  name,  then  a left  arrow,  and  then  the  link  name.  In  place  of  a single  input  port,  a 

list  of  ports  can  be  used  to  denote  that  each  port  in  the  list  is  connected  to  the  link. 

Contrary  to  tha  above  BNF  definition,  the  type  of  port  can  be  Included  (i.e.  input  port). 

Also,  when  several  ports  of  the  same  process  are  to  be  connected,  the  process  name 

may  be  left  out  after  appearing  once.  The  following  are  legal  connections: 

a. l  «-  alpha 

b. il,  c.i2  «-■  be*a 

d.l,  a.2,.3,.i4,  b.i7  ♦-  alpha 

The  results  of  these  lines  would  be  to  connect  input  port  A.I1  to  link  ALPHA, 

input  ports  B.il  and  C.I2  to  link  BETA  and  to  also  connect  input  ports  D.l  1 , A.I2,  A.I3, 

A.I4,  and  B.I7  to  link  ALPHA.  A.I1  will  remain  connected  to  link  ALPHA. 

A connection  between  a lin4'.  and  an  output  port  is  represented  by:  the  name 

of  the  link,  then  a left  arrow,  and  then  the  name  of  the  output  ports.  In  place  of  a 

single  output  port,  a list  of  ports  can  be  used  for  connecting  each  to  the  named  link. 

As  above,  the  type  of  port  may  be  Included  and  process  names  need  not  be  repealed. 

The  following  are  legal  connections: 

gamma«-d,2 

delta*-e.l,f.o3,.4,g.7 

The  two  types  of  node  connections  can  be  combined.  When  a link  appear* 
between  sets  of  ports  the  meaning  is  that  the  input  ports  (to  the  left  of  the  first  left 
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arrow)  are  connected  to  the  link  and  also  that  the  output  ports  (to  the  right  of  the 
second  left  arrow)  are  also  connected  to  the  link.  The  following  is  used  to  connect  the 
ports  X.I1,  Y.I2,  Z.I1,  S.03,  R.02,  T.03  to  the  link  GORP: 
x.l,y.2,z.ll«-gorp«-r.o2,t.3,s.3 

Another  method  for  combining  connections  is  used  to  denote  the  connection  of 
links  to  ports  having  the  same  number  but  different  types.  For  example, 
eta*-p.3,q.7*-nu 

means  the  same  as 

eta*-p.3,q.7 

p.3,q.7«-nu 

Note  that  the  ports  must  be  typeless  when  using  this  notation  since  it 
represents  connections  to  both  input  and  output  ports. 

A generalization  of  the  above  is  also  allowed: 

a.  1 9«-epsilon«-f.3,  l.7<-kappa«-c.3«-omega 

An  additional  notational  convenience  is  available  to  automatically  generate  a 
unique  link  name.  It  is  accomplished  by  using  port  names  on  either  side  of  a left 
arrow.  Thus, 

b. 3,c.2«-a.421 

means  to  generate  a new  link  name  (e.g,  LINK017)  and  connect  it  to  the  ports  used 
(B.3,  C.2«-LINK0 1 7<-A.42 1 ). 


A.2.ii.  Setting  transition  values 


The  following  is  'he  syntax  for  setting  transition  values: 

<set  probabilities:*::-  <port  name><repeat  factor>  - <initial  flagxprob  vector> 

<repeat  factor>  ::-  [<repeat  number>]  | null 

<repeat  number>  a positive  integer  less  than  262144 

<initial  flag>::-  * | null 

<prob  vector>  <prob  seq>  | <prob  seq>j  <prob  vector>  | <prob  vector>j 
<prob  seq>::-  <port  prob  comp>/<prob  $eq> 
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<port  prob  comp>::-  <1  or  0><port  number>  : <prob  comp> 

<Prob  comp>  <prob>,  <comp>  | <prob>  | , <comp>  | <prob>, 

A <prob>  is  a real  number.  If  it  is  in  the  range  [0.0, 1.0]  then  it  Is  the  assigned 

probability.  If  in  the  range  [2.0, 3.0]  it  is  a defaulted  amount  and  is  ignored.  If  it  is 

negative  then  the  value  becomes  defaulted.  If  it  is  larger  than  3.0,  then  this  Is  an 

error.  <comp>  is  any  non-negative  real  number. 

To  set  transition  probabilities  the  source  port  is  written  to  the  left  of  an 

If  the  port  activity  is  to  repeat  before  a transition  is  made,  then  the  repeat  factor  is 

placed  within  square  brackets,  between  the  port  name  and  the  To  the  right  of  the 

appears  the  destination  probability;  identified  by  the  destination  port  type  and 

port  number  followed  by  a colon  and  then  followed  by  the  transition  probability,  a 

comma,  and  the  associated  compute  time.  If  e V occurs  to  the  right  of  the  then 

the  named  port  is  designated  as  the  Initial  port.  The  following  are  examples: 

a. i2-o3:.5,1.6 

b. o3[6]-  o4:1.0,.l 

c. ll  - * 12:  .6,0.0 

These  lines  mean  that  p(A.I2,A.03)».5  and  the  related  compute  time  is  1.6.  Port  B.03 
repeats  six  times  before  entering  state  04  (each  time  computing  for  .1).  C.ll  is  an 
Initial  port  £.nd  p(C.Il,C.I2)«0.6. 

Several  abbreviations  can  be  used: 

1.  Either  the  probability  or  the  compute  time  can  be  le.'i  out. 

2.  The  following  is  a sequence  of  state  changes: 

a.i3-ol:1.0,.5 

a.ol-i2:.5,1.0 

a.!2«i4:1.0 

a.i4-o2:.2 

This  can  be  abbreviated  as: 
a.i3-ol:1.0,.5/  i2:.5,1.0/  i4:1.0/  o2:.l 

3.  More  than  one  sequence  or  single  change  can  be  shown  on  one  line: 
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b.0 1 6—i5:.3 
b.ol6-i2:.l/o3:.5 
b.ol6*o4:.5 
b.ol6*i3:.l 

becomes 

b.o  1 6— i5:3;  12:.  1/  o3:.5i  o4:.5;  i3:.l 


A. 2. III.  Model  manipulation  commands 

Several  Keyword  commands  are  used  to  manipulate  a model  representation. 
Their  functions  include  creating  link  attributes,  copying  nodes,  removing  nodes  or 
ports,  and  creatinp  special  types  of  process  structures.  The  following  is  a brief 
description  of  these  commands. 

ATTRIBUTES  is  used  to  assign  the  link  attributes  to  links.  The  specific 
attributes  are  maximum  queue  length,  initial  queue  volume,  start-up  time,  and  delay 
time. 

COPY  is  used  to  copy  nodes  based  on  an  existing  node.  It  can  also  be  used  to 
copy  ports. 

CLEAR  is  used  to  remove  all  processes  and/or  links. 

DENSITY  is  used  to  connect  a process  to  a link  as  if  the  process  sent  or 
received  messages  with  a rate  based  on  a given  probability  density  function.  The 
density  functions  available  are  exponential  and  normal. 

DISPLAY  is  used  to  display  model  attributes  at  the  terminal. 

REMOVE  is  used  to  remove  individual  processes,  ports,  and  links. 

A special  link  called  DANGLING  is  the  default  connection  to  any  unconnected 
port.  Explicit  connections  can  be  made  to  DANGLING,  but  a model  w II  not  be  well- 
formed  If  any  connections  remain  to  it.  DANGLING  can  not  be  removed. 


A.3  Model  Analysis  and  System  Commands 


A -8 


A.3.  Model  Analysis  and  System  Commands 

Keyword  commands  are  used  to  analyze  and  test  a model.  In  addlt  % there 
are  STEPPS  system  commands  used  to  interact  with  the  underlying  PDP-10  operating 
system. 

APPLY  is  used  to  apply  a function  that  is;  defined  external  to  the  STEPPS 
system  to  either  individual  processes  or  to  an  entire  connection  matrix. 

TEST  is  used  to  test  for  a well-formed  model.  It  is  also  used  to  test  whether  a 
model  is  deadlock-free. 

EXIT  is  used  to  exit  from  the  STEPPS  system  and  reenter  the  iJDP-10  operating 

system. 

LOAD  is  used  to  retrieve  STEPPS  commands  from  a PDP-10  file. 

SAVE  is  uted  to  save  the  representation  of  a model  onto  a PDP-10  file.  The 
representation  is  in  the  form  of  commands  to  recreate  the  items  saved. 

A.4.  Simulation  commands 

The  simulation  features  of  the  STEPPS  system  allow  for  the  assignment  of 
several  parameters.  Most  of  the  simulation  parameters  can  be  displayed  and  altered 
independently  of  the  invocation  of  the  simulation.  The  parameters  are  concerned  with 
scheduling,  data  collection,  and  tracing.  A model  can  be  simulated  for  a period  of  time 
and  then  a snapshot  can  be  taken  of  its  current  state.  Statistics  can  be  displayed  and 
the  simulation  may  be  continued.  No  alterations  can  be  made  to  the  model  while  a 
simulation  is  in  progress  and  the  STEPPS  system  prevents  this  from  happening  by 
asking  whether  the  modification  should  really  be  made.  If  so,  the  simulation  is 


terminated. 
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COLLECT  is  used  to  mark  the  processes  that  will  and  will  not  have  data 
collection. 

CONTINUE  is  used  to  continue  a stopped  simulation.  It  also  can  be  used  to  turn 
on  simulation  tracings. 

DISPLAY  is  used  to  display  the  simulation  parameters. 

SCHEDULE  is  used  to  assign  the  simulation  scheduling  algorithm,  to  mark 
process  priorities,  and  to  mark  which  processes  are  and  are  not  competing  for 
processors. 

SIMULATE  is  used  to  invoke  the  simulator.  Some  parameters  can  be  assigned 
using  this  command.  In  addition,  tracing  can  be  turned  on  by  the  command. 

SNAPSHOTS  is  used  to  display  the  status  of  process  nodes,  link  nodes,  and/or 
the  scheduler  when  a simulation  is  stopped. 

STATISTICS  is  used  to  display  collected  data  with  analysis  for  process  nodes, 
link  nodes,  and/or  the  scheduler  when  a simulation  is  stopped. 

UNSIMULATE  is  used  to  terminate  a simulation  that  has  stopped.  Once  this 
command  is  used,  the  simulation  can  not  be  continued. 

A.5.  Keyword  commands 

The  following  is  a detailed  description  of  each  of  th®  STEPPS  keyword 

commands.  The  commands  are  given  in  alphabetical  order.  Parameters  are  described 

* 

with  each  of  the  commands. 

APPLY 

<APPLY  cmd>  APPLY  <external  function  name><APPLY  param> 

<external  function  name>::-  <six  character  name> 

< APPLY  param>  GRAPH  | PROCESS  <list  of  process  names> 
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The  named  function  is  applied  to  either  the  entire  GRAPH  or  to  the  transition 
matrix  of  each  named  process. 

The  method  for  incorporating  an  external  function  with  STEPPS  depends  upon 
the  language  used  for  the  function:  BLISS,  SAIL,  or  FORTRAN.  SAIL  and  BLISS  are  the 
most  appropriate  languages  to  use  since  the  use  of  FORTRAN  requires  some 
restrictions  (I/O  can  only  be  performed  by  using  SAIL  procedures).  The  following  are 
the  required  procedures  to  use  a function  GORP  defined  in  different  languages. 

BLISS: 

1.  Define  GORP  as  GLOBAL. 

2.  Link  the  STEPPS  system  and  include  module  with  GORP. 

SAIL: 

1.  Define  SGORP  as  INTERNAL  and  add  7 dummy  parameters. 

2.  Add  CALLSAIL  (SGORP,  GORP,  1);  to  file  SETUP.BL!  and  recompile  it. 

3.  Link  the  STEPPS  system  and  include  module  with  SGORP. 

FORTRAN: 

1.  Define  FGORP  as  the  FORTRAN  function. 

2.  Compile  the  following  SAIL  module: 

ENTRY; 

EXTERNAL  FORTRAN  PROCEDURE  FGORP  (ARRAY  M); 

INTERNAL  PROCEDURE  SGORP  (ARRAY  M;  INTEGER  D1,D2,D3,D4,D5,D6,D7); 
FGORP  <M>; 

3.  Do  steps  2 and  3 for  SAIL. 

ATTRIBUTE 

<ATTRIBUTE  cmd>::=  ATTRIBUTE  <!ink  name  list>  <link  attributes> 

<link  attributes>  ::■=  attribute  assignment  | attribute  assignment  <link  attributes> 
<attribute  assignment  ::=  QUEUE:<integer>  | VOLUME:<integer>  | 

DELAY:<real>  | STARTUP:<real> 

Each  link  named  in  the  <link  name  list  is  assigned  the  attributes  named.  For 
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example,  to  assign  the  attributes  to  link  ALPHA  of  maximum  queue  length  of  3 and 
delay  time  of  2.0,  the  following  would  work: 

ATTRIBUTE  ALPHA  QUEUE:3  DELAY:2.0 

An  abbreviation  allows  several  links  to  obtain  the  same  attributes.  Thus, 
ATTRIBUTE  ALPHA,  BETA,  GAMMA  QUEUE:17,  DELAY:4.0 
assigns  the  s jme  attributes  to  links  ALPHA,  BETA,  and  GAMMA. 

CLEAR 

<CLEAR  cmd>  CLEAR  <clear  parameter 

<clear  parameter^:-  ALL  | null  | PROCESSES  | LINKS 

The  result  of  this  command  is  to  clear  the  model  of  all  PROCESSes,  LINKs,  or 

both,  null  Is  the  same  as  ALL.  For  CLEAR  ALL  the  model  name  is  also  reset  to  the 

default  model  name:  MODEL. 

COLLECT 

<rnt  I ECT  cmd>  COLLECT  <col  key>  <process  name  list> 

<col  key>  STATISTICS  I NOSTATISTICS 

The  result  of  this  command  is  to  mark  or  unmark  each  process  named  for 

simulation  statistics  data  collection.  Each  process  in  the  <process  name  list>  must 

already  have  been  defined  before  issuing  the  command.  The  default  is  to  COLLECT 

STATISTICS  for  each  process. 

CONTINUE 

<CONTINUE  cmd>  CONTINUE  <time>  <cont.  param> 

<cont.  param>  TRACE  | MODELTRACE  | 

FILETRACE  <file>  | <null> 

This  command  is  used  to  restart  (or  continue)  a simulation  where  it  halted  (see 
SIMULATE).  The  <time>  parameter  is  a real  number  representing  the  length  of  time  the 
simulation  should  continue.  TRACE  means  to  display  a simulation  traco  on  the  terminal 
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device.  FILETRACE  <file>  extends  the  named  PDP-10  file  with  the  simulation  trace. 
The  extension  TRA  will  always  be  used.  MOnELTRACE  extends  the  file  named 
<modelname>.TRA  with  the  simulation  trace.  <modelname>  is  the  current  model  name 
as  set  by  the  MODEL  command. 

COPY 

The  COPY  command  syntax  has  been  changed  since  the  examples  in  Chapter  111 
were  created.  Both  the  old  and  new  follow,  although  the  new  syntax  is  the  actual 
syntax. 

Old  syntax 

<COPY  cmd>::-  COPY  <copy  params>  : <master  item> 

New  syntax 

<COPY  cmd>::»  COPt'  <master  item>  TO  <copy  params> 

Common  syntax 

<copy  params>  <linK  list>  | <process  list>  | <port  item  list> 

<port  item>::«  <port  name>  | <type-less  port  name>  | 

.<1  or  Oxport  number>  | <port  number> 

The  purpose  of  the  COPY  command  is  to  duplicate  items  to  the  left  of  the  colon 
to  have  the  same  "attributes"  as  the  item  on  the  right  of  the  colon.  The  actual 
semantics  is  based  on  the  type  of  <master  iteri>  as  follows: 

LINKS  For  each  named  link,  the  attributes  of  the  "master  item"  link  are  copied. 
Only  the  attributes  are  copied,  but  not  any  connections  since  ports  can  only  Hp 
connected  to  one  link. 

Example 

A3<-FOO 

ATTRIBUTE  FOO  QUFUE:3  VOLUMES 
COPY  FOO  TO  BAZ,  GORP 

Now  BAZ  and  GORP  are  linked  with  identical  attributes  as  FOO  (Queue:3, 
Volume:7,  Delay:0,  and  startup:0).  However,  neither  is  connected  to  any  port  even 
though  FOO  is  connected  to  port  A.13. 
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PROCESSES  For  each  named  process,  all  of  the  attributes  of  the  <master  item> 
process  are  duplicated.  The  attributes  include  connection  to  links,  transition  matrix, 
and  simulation  parameters.  Only  an  unused  name  can  be  the  result  of  COPY.  Thus  a 
process  must  be  removed  before  its  name  can  be  used  as  a COPY  of  another  process. 

Example 

A.3<-F00 

A. 01 -*13:1.0/01:1 

COPY  A TO  B,C 

Assuming  that  B and  C are  previously  unused  names,  they  will  now  be  identical 
to  process  A.  Thus  the  above  COPY  command  is  a short  cut  for  the  following 
commands  (assuming  process  A was  previously  undefined): 

B. 3«-F00 

B. 01  -*13:1.0/01:1 

C. 3*-F00 

C.01 -*13:l. 0/01:1 

PORT'S  Named  ports  are  copied  based  upon  the  <master  item>  port.  Th9 
corresponding  connections  and  transition  matrix  vector  may.  be  copied.  If  the  master 
port  does  not  exist,  it  will  be  created  and  similarly  a new  process  may  also  be  created. 
The  ports  named  in  the  <port  item  list>  may  already  exist.  When  a new  process  is 
created  or  the  <port  item>  process  has  the  same  number  of  ports  as  the  <master  item> 
process,  all  probabilities  and  computation  times  associated  with  the  <master  item>  port 
are  set  for  the  <port  item  port>  When  the  above  dots  not  hold,  a port  only  is  created 
and  given  default  properties. 

The  transition  matrix  values  are  set  in  the  same  order  as  the  <master  item> 
port;  no  examination  is  made  for  concurring  port  number.  The  repeating  factor  of  the 
<port  item>  is  also  set  to  be  the  same  as  the  <master  item>  port.  When  the  ports, 
<port  item>  end  <master  item>  are  of  the  same  type,  of  the  same  process,  and  not 
already  connected  to  a link,  then  the  <port  item>  port  is  connected  to  the  same  link  as 
the  <master  item>  port.  COPY  makes  no  change  in  a process’s  initial  state  clnce  that  is 
a process  property,  not  a port  property. 
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As  a notational  extension,  the  process  name  and/or  port  type  may  be  left  out 
of  the  <pcvt  iter.'>.  When  this  occurs,  the  previously  named  process  or/and  port  type 
(to  the  left  in  the  <port  item  list>  is  used.  The  initial  default  process  name  or/and  port 
type  is  the  <master  item>  port  process  name. 

Example 

FOO-A.2+-BAZ 

A.12—02: 1/12:1 

D.ll  - 05:1/02:1 

COPY  A.12  TO  A.14,  D.02 

The  above  copy  command  replaces  the  following  commands  (assuming  process 
D did  not  exist  previously): 

A.l4*-BAZ 

A.I4  - 02:1 

D.02  - 05:1  ! since  05  is  the  third  port  of  D. 


DENSITY 

< DENSITY  cmd>  DENSITY  <den.  function  type><den.  param*> 

<den.  function  type>  ::■  NORMAL  ) EXPONENTIAL 
<den.  param>  ::■  PORT  <port  namc>  | LINK  <linK  name> 

FOR  <positive  integer>  | GRAIN  <pOsitive  integer> 

MEAN  <positive  real>  | VARIANCE  <non-neg.  real> 

EPSILON  <positive  real> 

Given  a port  name  and  a link  name,  connections  and  port  transition  values  are 
generated  to  represent  the  named  probability  density  function  se^vce  rate  as  seen  by 
the  link  to  (or  from)  the  port.  The  mean  (default:10.0),  variance  (default:1.0),  and 
appropriate  grain  (same  as  FOR;  default:10)  can  be  speeded.  EPSILON  represents  the 
density  mass  of  the  distribution  tail(s)  and  is  defaulted  to  0.001. 

An  exact  description  of  the  result  of  the  DENSITY  command  is  as  follows  where 
the  process  name  is  PROCESS,  given  port  type  is  TYPE  and  the  given  port  number  is 


n. 


1.  Perform  PR0CESS.In«-PR0CESS.0n,  i.e.  create  a link  and  two  ports. 

2.  Create  ports  PROCESS.TYPfin+l,  . . .,  PR0CESS.7YPEn+(grain  size)  and 
connect  them  all  tc  *he  named  link. 
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3.  Do  PROCESS  OR  ■ ln:l 

4.  Do  PROCESS. TYPEn+l  - PROCESS.On:l 

5.  COPY  PROCESS.ry  PEn+l  TO  PROCESS.7YPEr+2 

PPOCESS.7YPPn+(grain  size) 

6.  Set  PROCESS.In  transition  matrix  probabilities  and  time  values  dependent 

on  the  named  density  function.  The  successor  ports  are  TTPBr+1 

7TPi?R+(grain  size). 


DISPLAY 

<DISPLAY  cmd>  DISPLAY  <display  arguments* 

<display  arguments>  ATTRIBUTES  <link  list>  | COLLECT  | COM.-ETE  | 

CONNECTIONS  <port,  process,  link  list>  | DANGLING  | 

GRAPH  <DISPLAY  GRAPH  parameter  | LINKS  | LOOPS  | 

MODELNAME  | PATHS  “^obj  1>  TO  ^bj  2>  | PORTS  process  list*  | 
PRIORITY  null  | PRIORITY  <process  list>  | 

PROCESSES  | SCHEDULER  | TRANSITIONS  <process,  port  list> 
<DISPLAY  GRAPH  parameters*::-  ALL  | ATTRIBUTES  | JATTRIBUTES  | 

CONNECTIONS  | TRANSITIONS  | null 

The  DISPLAY  command  is  used  to  display  items  in  the  STEPPS  model  and  states 
of  the  STEPPS  system  (though  not  of  a STEPPS  simulation)  on  a terminal.  Each 
argument  is  a command  to  display  different  objects  and  will  be  described  below. 
ATTRIBUTES  Display  the  attributes  of  each  link  named. 

COLLECT  Display  which  processes  will  and  will  not  collect  statistics  during  a 
simulation. 

COMPETE  Display  which  processes  will  and  will  not  compete  for  available  processors 
during  a simulation. 

CONNECTIONS  Display  the  connections  to  each  port,  process,  and  link  named. 

DANGLING  Display  which  ports  are  not  connected  to  any  created  link.  These  ports 
are  connected  to  the  special,  non-createable  link  named  DANGLING. 

GRAPH  ALL  or  GRAPH  Display  all  link  attributes  and  connections,  all  process 
transitions,  all  competing  and  non-competing  processes,  and  all  collecting 
and  non-collecting  processes. 
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GRAPH  ATTRIBUTES  Same  as  JATTR1BUTES  and  XONNECTIONS. 

GRAPH  JATTR1BUTES  Display  just  attributes  cf  each  'ink. 

GRAPH  JCONNECTIONS  Display  just  the  connections  for  the  entire  graph. 

GRAPH  JT  RAMS  IT  IONS  Display  just  the  transitions  of  each  process. 

GRAPH  TRANSITIONS  Same  as  JTRANSITIONS  and  XONNECTIONS. 

LINKS  Display  the  name  of  each  link. 

LOOPS  Display  each  cycle  in  the  graph. 

MODELNAME  Display  the  model  name,  the  date,  and  the  current  time. 

PATHS  Display  all  paths  between  the  named  nodes. 

PORTS  Display  the  port  names  for  each  process  named. 

PRIORITY  Display  the  priority  number  of  each  process  named  (or  all). 

PROCESSES  Display  the  name  of  each  process  and  its  priority. 

SCHEDULER  Display  the  simulation  scheduling  discipline. 

TRANSITIONS  Display  transitions  for  each  port  or  entire  process  named. 

EXIT 

<EXIT  cmd>::-  EXIT 

Exit  from  the  STEPPS  system.  If  the  EXIT  command  is  issued  in  a file  that  is 
LOADed,  the  result  is  to  return  to  the  STEPPS  LOAD  command  (See  LOAD). 

LO/W 

<LOAD  cmd>::-  LOAD  <file  name>  <!oad  param> 

<load  param>  ECHO  | null 

LOAD  is  used  to  retrieve  STEPPS  commands  from  a stored  PDP-10  file.  <f ile 
name>  is  the  standard  PDP-10  file  name,  viz.  device:name.ext  (only  device  DSKs  are 
allowed).  If  no  extension  is  used  the  extension  TEP  is  assumed. 


MODEL 
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<MODEL  cmd>  MODEL  <file  name> 

For  convenience,  each  model  can  be  named;  default  model  name  is  MODEL. 
When  a LOAD  is  performed,  without  any  parameters,  the  model  name  becomes  the 
LOAD  file  name.  The  MODEL  command  can  be  used  at  any  time  to  change  the  current 
model  name. 

REMOVE 

<REMOVE  cmd>  REMOVE  <port,  process,  link  list> 

Each  item  (port,  process  or  link)  in  the  parameter  list  is  removed  from  the 

graph.  When  a link  is  removed,  any  port  that  had  been  connected  to  it  becomes 

connected  to  the  special  link  DANGLING.  When  a process  has  only  one  port,  that  port 
can  not  be  removed;  instead  the  process  should  be  removed. 

SAVE 

<SAVE  cmd>::«  SAVE  <save  parami> 

<save  param>  ALL  | COMPETE  | EXTEND  | FILE  <111®  name>  | 

GRAPH  | LINKS  | NODES  | <!ist  of  nodes>  | 

PRIORITY  | PROCESSES  | SCHEDULER  | null 

The  SAVE  command  is  used  to  save  a model  description,  components  of  a model 

description,  and  simulation  parameters  onto  a PDP-10  file.  Its  common  use  is  saving 

the  entire  description  and  parameters  onto  the  file  named  by  the  MODEL  command. 

This  is  accomplished  by  simply  using  SAVE  with  no  parameters.  Tha  use  of  the 

parameter  ALL  is  the  same  as  null  except  that  a file  name  is  required.  The  format  of 

the  data  written  is  the  same  as  that  used  by  the  DISPLAY  command,  as  follows: 

ALL  - same  as  DISPLAY  GRAPH  ALL 

COMPETE  - same  as  DISPLAY  COMPETE 

GRAPH  - same  as  DISPLAY  GRAPH  ATTRIBUTES  and  DISPLAY  GRAPH  /TRANSITIONS 
LINKS  - same  as  DISPLAY  GRAPH  ATTRIBUTES 
PRIORITY  - same  as  DISPLAY  PRIORITY 
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PROCESSES  — same  as  DISPLAY  GRAPH  TRANSITIONS 
SCHEDULER  — same  as  DISPLAY  SCHEDULER 

The  FILE  parameter  is  used  to  name  the  file  to  receive  the  data.  No  device  can 

be  specified. 

The  EXTEND  parameter  signifies  that  the  named  file  is  extended  Instead  of 
replaced. 

The  NODES  parameter  signifies  that  the  connections  and  attributes  or 
transitions  of  '.ne  named  nodes  are  to  be  saved. 


SCHEDULE 

<SCHEDULE  cmd>  ::-  SCHEDULE  schedule  parameter 
<schedule  parameter>  ::-  BY  scheduling  sty le>  | 

COMPETE  <processli$t>  | NONCOMPETE  <process  list>  | 

PRIORITY  • process-priority  list> 

<process-priority>::-  <p'ocjss  name>:<non-negative  lnteger> 

Scheduling  styled-  LINK  | LKPR  | PROCESS  | PRLK  | FIFO  I RANDOM 

The  SCHEDULE  command  is  used  to  set  attributes  for  the  simulation  scheduler. 

The  BY  parameter  is  used  to  set  the  scheduling  style.  The  PRIORITY  parameter  is  used 

to  set  priorities  for  processes.  The  COMPETE  and  NONCOMPETE  parameters  are  used 


'.**t  which  processes  will  and  will  not  compete  for  available  processors. 


SIMULATE 

<SIMULATE  cmd>  ::-  SIMULATE  <time>  <sim  param*> 

<time>  <a  non-negative  real  number> 

<sim  param>::-  FILETRACE  <f ile  name>  | 

MODELTRACE  | PROCESSORS  ^positive  integer>  | 

SCHEDULE  scheduling  style>  | SEED  <positive  lnteger>  | 

TRACE  | WORKINGSET 

The  SIMULATE  command  is  used  to  initiate  a STEPPS  model  simulation  for  the 
length  of  time  specified.  The  other  parameters  set  simulation  details  as  explained 
below.  No  more  than  one  of  the  parameters  TRACE,  FILETRACE,  and  MODELTRACE  can 


be  used. 
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PROCESSORS  sets  the  number  of  processors  available  for  the  simulation. 
SCHEDULE  resets  the  simulation  scheduling  style:  LINK,  PROCESS,  FIFO,  RANDOM,  LKPR, 
or  PRLK.  SEED  sets  the  simulation  random  number  generator  seed  for  this  simulation. 
Each  simulation  starts  with  the  same  internally  defined  seed  unless  specifically  set  by 
the  SEED  parameter. 

The  TRACE  parameter  causes  messages  to  be  displayed  on  the  terminal 
describing  each  simulated  event.  FILETRACE  extends  the  named  file  with  the  trace 
information.  MODELTRACE  extends  the  file  <model  name>.TRA  with  the  trace 

information. 

The  WORKINGSET  parameter  causes  those  processes  for  which  statistics  are 
being  collected  to  addition^  collect  statistics  showing  related  working  sets  of 
processes. 

SNAPSHOTS 

SNAPSHOTS  cmd>::-  SNAPSHOTS  <snap  param*> 

<snap  param>  FILE  <optional  file  name*  | LINKS  | 

PROCESSES  | NODES  <process,  link  list>  | SCHEDULER  | null 

The  SNAPSHOTS  command  is  used  to  display  current  status  of  a simulation  that 

has  stopped,  but  not  been  terminated  (UNSIMULATE). 

The  FILE  parameter  designates  that  the  snapshot  is  to  extend  the  file  named 
(colon  precedes  the  file  name)  or  the  <mode!  name>.TRA  file.  The  other  parameters 
name  the  items  to  be  examined;  namely  the  SCHEDULER,  all  LINKS,  all  PROCESSES,  or 
individually  named  nodes.  A null  parameter  means  all  items. 

STATISTICS 

STATISTICS  cmd>::-  STATISTICS  <stat  param*> 

<stat  param>  FILE  <optional  file  name>  | LINKS  | 

PROCESSES  | NODES  <process,  link  list>  j SCHEDULER  | null 
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The  STATISTICS  command  is  used  to  display  the  current  accumulated  statistics 
of  a simulation  that  has  been  stopped,  but  not  terminated  (UNSIMULATEd). 

The  meanings  of  the  parameters  are  the  same  as  for  the  SNAPSHOT  command. 


TEST 

<TEST  cmd>::-  TEST  <test  param> 

<test  param>  GRAPH  | DEADLOCK  <test  dead  param>  | 

NODES  <process  list> 

<test  dead  param>::-  TRACE  | VERBOSE  | NSAVE  | 

NSTRACE  | NSVERBOSE 

The  TRACE  command  is  used  to  analyze  the  structure  of  a STEPPS  model.  The 
GRAPH  parameter  means  to  determine  whether  the  entire  graph  is  well-formed 
(including  each  process).  The  NODES  parameter  is  used  to  determine  whether 
individual  processes  are  well-formed. 

The  DEADLOCK  parameter  means  to  determine  whether  any  deadlocks  exist  in  a 
STEPPS  modpl.  The  process  destroys  the  model,  so  an  automatic  SAVE  is  normally 
performed  to  a unique  file  before  the  deadlock  test  procedure  begins  and  the  model  is 
normally  restored  afterwards.  Two  types  of  traces  can  be  performed  showing  how  the 
deadlock  algorithm  works.  The  DEADLOCK  subparameters  are  used  to  determine  how 
the  saves  and  tracer  are  performed. 

TRACE  --  Trace  the  application  of  each  reduction. 

VERBOSE  Same  as  TRACE  plus  display  all  transition  matrix  changes. 

NSAVE  --  Allow  the  model  to  be  destroyed  without  being  saved  first  nor  restored 
afterwards. 

NSTRACE  — NSAVE  + TRACE. 

NSVERBOSE  - NSAVE  * VERBOSE. 

UNSIMUL/1TE 

<UNSIMULATE  cmd>  UNSIMULATE 

The  UNSIMULATE  command  is  used  to  terminate  a simulation  that  has  stopped 

so  that  it  can  not  be  restarted  (CONTINUEd). 
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APPENDIX  B 

Using  the  STEPPS  System 


This  appendix  presents  a protocol  of  the  use  of  the  STEPPS  system  for  the 
Chapter  III  Bliss/li  example.  A discussion  of  the  Chapter  III  Hearsay  II  example  input 
problem  and  Its  solution  Is  also  presented. 


B.  1.  Bliss/l  1 example  protocol 

An  annotated  protocol  of  the  use  of  the  STEPPS  system  for  the  Bliss/11  model 
shown  in  Figure  III- 1 1 is  presented  below.  Following  the  protocol,  the  simulation 
commands  used  for  the  experiments  will  be  presented.  A sample  of  the  statistics 
produced  upon  request  after  a simulation  will  also  be  presented. 


I PROTOCOL  FOR  BUSS/11 
aMOOEL  BU 

♦OEMS  I TV  EXPON  PORT  LEX. 01  LINK  LS  HERN  .26 

Pori  LEX. 0188  Link  LS  (loan  .26888  Epallon  .68188  For  (Crain)  616 
Link  nama  “LINK881"  Mill  ba  uaad. 

aOENSITY  EXPON  PORT  SYNFL0.06  LINK  SO  HERN  .116 

Port  SYNFL0.0888  Link  SO  Naan  .21686  Epallon  .66166  For  (Crain)  616 

Link  nama  ’LINK682"  will  ba  uaad. 

aSYNFLO.  120-LS  I INPUT  FROfl  "LEX" 

aSYNFLO. 00.  I6i8|  I26il  I RFTER  OUTPUT,  INPUT  FROfl  “LEX" 

aSYNFLO.  126.  I6tl  ! REQUEST  flORE  INPUT 

aOENSITY  EXPON  PORT  0ELRY.06  LINK  OT  HERN  6.637 

Port  0ELRY.0888  L Irk  OT  Naan  .83766  Epal Ion  .66166  For  (Crain)  616 

Link  nama  "LINK083"  will  ba  uaad. 

aOELRY.  I28«-S0  ! INPUT  FROfl  “SYNFLO* 

aOENSITY  EXPON  PORT  TNBIN0.06  LINK  TC  HERN  .122 

Port  TNBIN0.0868  Link  TC  flaan  .12288  Epallon  .66166  For  (Crain)  616 

Link  nama  "LINK884"  will  ba  uaad. 

aTNBINO.  I26«-0T  I INPUT  FROfl  “OELflY* 

aOENSITY  EXPON  PORT  C00E.06  LINK  CF  HERN  .6*4 

Port  C00E.0866  Link  CF  Naan  .68468  Epallon  .66166  For  (Crain)  616 
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Link  n»m*  "LINK685"  Mil'  b«  used. 

♦CODE. I2B«TC  ! INPUT  FROM  "TNBIND" 

•DENSITY  EXPON  PORT  FINAL, 08  LINK  FP  HERN  .296 

Pori  FINAL. DBB8  Link  FR  ritan  .29688  Epillon  .88180  For  (Grain)  818 
Link  nam*  "LINK886"  Mill  ba  ui«d. 

•FINAL.  1 2 8«-CF  I INPUT  FRDH  "CODE " 

♦COPY  DELAY. 120,  TNBIND. 120,  CODE. 128,  FINAL. 128  i SYNFLO.I20 
♦COPY  DELAY. DC,  TNBIN0.08,  CODE. 00,  FINAL. 00  i SYNFLO.D0 

♦RESULT. I0*FR  I DEPOSITORY  FOR  RESULTS 

•SCHEDULE  NONCOflPETE  RESULT 

♦ATTRIBUTE  TC,CF,DT,FR,LS,SO  QUEUE)  18 


The  simulations  were  initiated  by  using  the  SIMULATE  comm  ind.  The  following 
command  was  used  to  simulate  the  model  using  6 processors  and  the  FIFO  scheduling 
algorithm  for  100  time  units: 

S Imulato  188  proc*iior»  6 ichadul*  *l*o 


The  other  Bliss/11  experiments  were  simulated  by  modifying  the  SIMULATE 
command  parameters  for  timing,  number  of  processors,  and  scheduling  algorithms  as 


described  in  Appendix  A.  In  order  to  eliminate  the  requirement  for  recreating  the 
model  for  each  simulation,  the  model  was  first  written  on  a file  (using  the  SAVE 
command)  and  for  each  simulation  it  was  restored  (using  the  LOAD  command).  A sample 
of  the  stahstics  displayed  for  links  is  shown  below: 


•statistics  1 »t  t ima  • 109 
Modal  911  ! 1 3-May- ?6  03 • *6 


St  at  i«t  ics 

■ t l 1 me 

100.000 

S 

prcccf*or». 

»••• 

L 

T i m» 

No. 

No. 

No. 

£». 

E«. 

E». 

1 Tima  1 

; No. 

1 Tims 

1 Tima 

Ac  cats 

Raquest 

Saoda 

ln»c  t i v* 

SUM 

Sends 

P«Qlt 

Oltn 

Wait 

Ovflo 

Inactv*  Startups 

5t»rtup 

Oct iva 

Rat* 

Pat  t 

R»t  * 

cr 

100.00 

1 

337 

320 

9.I7S 

.007 

• 571 

loo. eci 

153 

.001 

.001 

IS 

30 

.30 

DT 

100.00 

1 

360 

349 

1.529 

.287 

.278 

100. 00* 

.141 

.001 

.001 

.14 

.29 

28 

FP 

100  09 

328 

32" 

328 

000 

1000 

000 

100.803 

50.001 

.001 

.001 

. IS 

39 

.31 

LINt  001 

100  00 

370 

377 

377 

.000 

.000 

ooo 

ioo. eoi 

50.133 

.001 

.001 

.13 

26 

.26 

LINK 002 

100  99 

3 24 

37) 

371 

120 

.000 

.000 

100.093 

13  673 

.001 

.001 

.13 

.27 

.27 

LINK 003 

100.00 

120 

360 

360 

■ 570 

.000 

.000 

100. 0O% 

17.783 

.001 

.001 

14 

■ 28 

.28 

L1NKC04 

100.00 

237 

349 

349 

.207 

.000 

000 

100.001 

33.953 

■ 001 

.001 

.14 

29 

29 

L1NK00S 

100.00 

277 

330 

330 

. 139 

000 

.000 

100.001 

40.961 

.001 

.001 

IS 

39 

39 

LINK  006 

100.00 

320 

320 

320 

.007 

.000 

000 

leo.eoi 

SO. 001 

.00’ 

.001 

. IS 

.30 

.39 

LS 

100.09 

2 

376 

37) 

3 915 

.128 

.836 

100.001 

.271 

.001 

.001 

13 

.27 

26 

SO 

100.00 

2 

371 

360 

1 062 

■ STB 

.027 

ioo. eoi 

.273 

001 

.001 

14 

28 

.27 

TC 

100.00 

2 

343 

330 

6.226 

. 130 

.298 

100.001 

.293 

.001 

001 

.15 

39 

■ 29 
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B.2.  The  STEPPS  Hearsay  II  model 


The  STEPPS  model  of  the  Hearsay  II  system  was  discussed  In  Chapter  III. 
However,  unlike  the  Bliss/11  model,  the  exact  Hearsay  II  model  was  not  shown  since  it 
is  too  large  to  place  into  the  text  of  Chapter  III.  It  was  found  that  many  of  the 
structures  used  for  the  Hearsay  II  model  were  similar,  but  not  close  enough  to  utilize 
the  STEPPS  command  COPY  to  facilitate  input  of  the  model.  A STEPPS  feature 
discussed  in  Chapter  VI  as  a future  system  tool  for  reproducing  groups  of  processes 
and  links  might  have  been  u:?ful.  Instead  of  implementing  that  feature,  the  action 
pursued  was  to  create  a simple  preprocessor  program  (in  SAIL)  to  convert  a 
description  of  a Hearsay  II  model  into  a form  appropriate  to  the  STEPPS  system.  The 
following  is  an  example  of  the  inout  to  the  praprocessor.  The  actual  probabilities  used 
in  the  STEPPS  Hearsay  II  model  are  shown. 


procr**  k»l*lo  loci'*  cl  .c2.cS  .word.pN  n 

compute-  1 IPO  done 

proce  a*  prelelo  loci'*  c 1 1 «c  1 * e-c  1 lb.c  1 1* -cl If .c  1 1 9 *c  1 Ih.cl4.cl4e.cl4b 
compute  P.70  m voir#  l-*|elo  1 

pr  ore* » prt|p»yn  loci'*  CP**9-P**9  1>P**9  2 
compute  50 

invoke  I* « Icstgt . ' 02  G53 
invole  W»|p*yn 1.951  650 
done 

proce**  kvlpern 

lock*  c9.c9*.c9f  »c9*.c9H.c  10. c lOe.clOb.c  1?. 

cl7b.c  I2e.cl2f  .clZg.r  12h.cl3.cl3t.cl2b.caKn. awn  1 .**n  2. cp««*p***  1 .p»*»  2 
compute  25.950 
done 

proce**  k*lc**9 

lock*  c9.c9*.c9f  .c9g.c9h.c  10.c  10*.c  lOb.c  12. 

c 12c .c  I2e  Ci2f .c129-c 12H.c 13-c 13e-c I3bc«nn.«vn  1 ,e-n  2.cp«e9>P**9  l«P*eg  2 
compute  25.945 
done 

proce**  prelrpol 

lock*  »M»ent  .*Mword  .wor  d-wr  d*urn  ~.*r  n .phon  .cm^n  .avn  1 .**n  2>cp*€9>p*t9  l»P**g2.**l 
compute  31 
Invoke  k* | uvi . 376 
done 

proce**  k»|uv 

lock*  cl  .c2.c4.cS.c7,c7*.c7b.cB.c9.c9*.c9f  .c9m.c9h,cH. 
clOe.ci0b.cll.clle.cllb.clle.cllf.cll9.cllh.ci2. 
cl2c.cl2e.cl2f  .cl29-cl2h.cM.cMe.cl4b 
compute  134 
don* 
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proc*«*  pr*|««9 

lock*  cr**q.p**g  1 p**9  Z.s*9 

compute  35-100 

invoke  l>n|r»9 
don* 

proem  k • I f *9 
loot*  m 
co«pu**  4nn 
C Of'PU  t * 400 
compute  400 
compute  400 

don* 

pror#**  prelutb 
loct  * c 4 , c 5 
compute  50 

invoke  kslutbi  057  60 

dor* 

process  tslutb 

lor  k 5 cZ  r 3-r.  3*  c3b  .c4  .cS  -c6  -c6t  c6f  .cSg.cSH-c  13.c  13*.  cl  3b 

comput*  30 

compute  30.150 

comput*  30.150 

don* 


proC*«»  pr  • | P»C 

loci,*  c3.c3*.c3b.c7.c7§.c?b 

compute  50 

InvoV*  ks  | irrehl  1 3 1 35. belt  Imei . 13  135 

done 

pr  oc  •»  1 \>  n | tear  ch 

I oc !•«  c?.c3.c3e.c3b.c4,c5  cS.c6e.c6f .c69.cGH.c7.c7e.c7b.cB.c13.cl3e.cl3b 
compute  50.1100 
compute  Z00. 1 100 

don# 

pr  oc*?*  W » 1 1 1 me 

lock?  cZ.r3.c3e.t3b-c4.c5.cS.cSe.c6f  -c6g  c6H.c7.c7e.c7b.cB-cl3.cl3e.cl3b 
compute  50-ZZ5 
compute  75.ZZ5 

don* 

le»ienn  s«g.ps«g  1 -p**g  Z.mvn  1 .m«n  Z-phon  . *um.wr  dsurn  .word. 

*hdwor  d . »Hd»*n  t 

cr locks 

cpteq  Pf*q  Z Pf*9  I 
emm  m»r>  Z m<*n  ] 
cZ  cl  *urn 
c3  uord  cZ 
c4  wr  deurn  cB 
c5  wrdsurn  *grn 
cS  cB  clZ 
c >’  i urn  clO 
cB  turn  phon 
c9  phon  clZ 
C 10  phon  cm»n 
C 1 1 cm*n  C 1 4 
c I Z c«*n  cpseg 
c13  phon  CPS*9 
cM  epsea  *#g 
C 1 4 O p»*5  1 s*g 
c I 4b  p**g  Z s*g 
t13e  phon  p**g  1 
c 13b  phon  pseg  Z 

c 1Z*  m«n  1 pseg  1 
clZf  m»n  1 pseg  Z 
CIZ9  mvn  Z pr*9  1 
C IZh  m»n  Z p»*9  Z 

c I I • m»n  1 c I 4 
c 1 lb  m«*n  Z cM 
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cl  It  1 cHt 
cl  H *»»n  1 cMb 
c 1 19  **'"  2 cMi 
c 1 1 h a**n  2 cHb 

clOt  phon  a»n  I 
C I ftb  c hon  tun  2 

c9<  rHon  cl2* 
c*)f  c 1 

c9*  rbon  c 12* 

c9H  pKon  c!2h 

c?t  »*jrn  cl0t 
K?b  turn  cl  8b 

(St  c8  c 12* 
c6f  c8  c!2f 
c6*  c8  c 1 2«| 
c6h  c8  c!2H 

c 3#  word  c ?f 
c 3b  word  c7b 

dont 
f In  1 

The  result  of  the  Hearsay  II  model  generation  is  the  STEPPS  model  which 


follows: 
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*od*l  nwlb]  ' losing  b>  th*  7 l».lCon  lftvftW  * 2 tublftvftlft 
Toprftl.pq)  Toprft|p*C  Topf*|p*yn 

PCftftUctor  . o 1 ?S/nf)  1.  oZ ' <3  )Zl/o$  1*  o3<  e.0SZ/o9d» 

Topr  • | tft<)  Topr«|Uttb  Topcft|*lo 

PcftftUctor.  ,P.  04  009 /oP  1:  oS'0  96$/o0'  1 i o$.  0.002/00*  1 1 

pctrlrctor  o0>*i0il.l  ' co»ft  tviry  1 unit  of  tiftft 

PC  **  lftC  tqr  < 0*  *FC  **l*pc*ft|«ctor  .0 

pr  • I r po  1 . 1 * t opr  v | r po  I *pc  tftlftc  t or  1 
pr  ftlrtc • I ►top/ * I ptc »pc tftlftc  tor . ? 
prplpfyn  1 ►t0prp|p»yn*pc»»l«ct0r  3 
pr  • | f«g.  !•  topr  «|  tft<t»pc  office  tor  1 
prplutb  ] *topr »1 tutb*pc?ftlftctor  5 
Pr • I * 1 o . 1 * t opr  ft|ftlo*pc  tftlftc tor .6 
tcH^d  nonco»p«(t  PCfftlftctor 


* ^ J • I o Locb»  C 1 » cZ • c5 • wor d > phon 
b * Iftlo  « 1 -»  ol9) , • ZOO 
b 1 1 ft  I Q . I ] a o 1 02 ' . 200 
b * I ftlo  1 1 ■ o 103'  ZOO 
b ft | • 1 n . i).  o104i  . 200 
b» I ftlo  1 • olOS'  ZOO 
twl  |cl*b«|clo.l01*fMl|cl 
twu|cl»b*|*lo30l 

bft I • 1 O Ol0*a 1 101 l 1/O301 I 1.  1100  000/02:  1 
tMl  I c Z - W • | «lo  !02*fwl  IcZ 
twulcZ*b.|t|o  30Z 

ba|»lo  olOZ-'lOZ  l/o30Z  ].  1 100. 000/oZi  1 
tw] |cS*bft|«lo  103‘fwl | C S 
( muIcS* bft  | ftlo  . 303 

b ft | • 1 o p103m1Q3- l/o303-  1.  1 100.000/oZ'  1 
i lb  I nor  d*b  s | #lo.  104*  fib  | war  d 
ulb I wor d*b i | ftlo ■ 301 

bftlftlo.pl  04 1|  104 1 1 /o304  i 1.  1 100. 000/oZi  1 
t J b | pho n * b * I ftlo • 105*f lb |phon 
ulb |phon»b • | ftlo  305 

bftlftlo  oieS-.lCS' 1/03A5  1.  1100  000/oZil 

b ft | ft  1 0 . t Z*b  ft | ftlq . o2 
bftlftlo. oZ" 1Z1  1 
bftlftlo  »2»  1 1 ■ 1 

' Pr  ft  I • 1 o Locbft  cl  1 .C  1 lft.cllb.cllft.cMf  .cllft 
• .c 1 lH.cl4.cl4ft.cl4b 

.rrft  I • 1 o 1 1 ■*  olOl : . 109 
pr • I ftlo. 1 1»  o 1 02 • .100 
pr • | ftlo . 1 1 ■ ol03i  .100 
pr  ft  I ft 1 0 • I 1 ■ 0 104 l 100 
pr  * I ft  1 0 • l|>  0 J OS ‘ • 100 
’ Pr ft Iftlo • • 1 ■ olOGr  100 
Pr  ft  I ft  1 0 . 1 la  o 1 0?>  . 100 
Pr • | ftl o . • 1*  olO0  100 
pr  ft  I ft  1 q . I 1 a ol09  100 
pr  ft  I ft  1 q . * la  ol  101  100 

twl  Id  l*pr  ftl  «]q  ]0]*fwllclJ 
twulc 1 l-pr«|»lo  301 

prftlftlo  olOl*  1 101 1 l/o301.  1.  70. 000/oZ'  1 

tw]  Ic  1 lft*prft| ftlo. 102*  fwl Icl Jft 

t»u  |c  1 lft‘pr  «|  tin  302 

pr  ft  I ft  I o . o 1 02  ■ ■ 1 02 1 1 /«>  30Z  r 1.  70.000/oZ'l 

twl  U 1 lb* prft|«lo.  103* fwl |c] lb 

t mu  I c 1 1 b*  pr  « | • 1 o . 303 

prftlftlo. o!03- 1 103' 1/o303j  1.  70.000/oZ'l 

twl  lc  1 l«*prft|ftlo.  104'  fwl  Id  1« 

t wu  | c 1 1 ft  * pr  • | • 1 q . 301 

prftlftlo. Ol04*rl01i 1/o301i  1.  70.000/O2il 

twl  lc  Ilf*  prftlftlo.  1 OS* fwl  Id  If 

t^iulcllf* prftlftlo  30S 

prftlftlo  ol05*' 105:  1/o30Si  ) , 70.00O/o2il 

twl  |c  1 1 9* prft|»|o  . 106* fwl  Id  I9 

t mj  | c 1 1 9*pr » | ftlo . 30$ 

prftlftlo  0 306.  ■ 106,  1/0306,  I.  70  000/o 2 1 1 
twl  |c  I lh*pr»iftlo.l07»ftli|dih 
twu  lc  1 |h*pr  • | ftlo.  307 

prftlftlo  ol07.  , J07i  l/o30?r  |.  70.000/oZil 
twl  lc 1 1*pr  ft  I ftlo. 109* fwl lc  M 
twulcl4*prft|ftlo3O0 

prftlftlo- 0)09-1109  I/o306  1.  70.000/o2'l 

twl  lcl4ft*prft|«lo. 109* f«l | c 1 4ft 

twu|cl4ft*pr«l«lo  309 

prftlftlo. ol09*  1 109' l/o3$vi  1.  70  000/o2»  1 


twl |c 11b*pr • |«lo. 110*  fwl Icllb 

twu  li'.l  4b* prftlftlo  .310 

pf*i«io.oiioMii0.i/o3i«i  1 Te.eee/oz.i 

•"■•'•lo.  l3.pro|p|o  0 2 

rrtlKlooZ.  1 ? 1 1 

Wlslo.  |.vl>  lt.fltlo.pr.  Itla.MI 

prp|p|o  i3.o90l  1 / 0 3 ) 

prplolo. t3>pre|plo  o3 

pr»|ploo3*i3i | 

Prelplo  .3.  ill) 

1 • I r>>.n  LoeWt  rpfra.p,*,  | ,p.„  3 

prolptrn. 1 |.»  o I 0 1 , . 333 

pr»|pt»r>  l|.  olOCi  .333 
pi  plptrn . 1 J*  o|03  331 

t“l  I cpt ep.pr  e | pt i*n . |0|.C«|  Icpt*, 
tnvilcrfpj.prelrfrn  3fl| 
prtlp.rn  olOl. . J0| , | /o30| , |,  50.000/o3il 
t H Ipse,  I -pr p |pt rn . 1 03- f II,  |pte,  I 
I -pr p I ptrn . 30? 

prelPfrn  aipr.iior, I/O303,  j,  5e.pe0/o3i I 

l!Hp*e9  :.pr*|pem.  |03.f||,  |p„,  z 

ult It'e?  3*pr*|ptrn  303 

prrlrtrn. O|03., |03, j/tjnj,  ,,  50.000/eZl| 

prplptrn. i3-prp|pf rn.o3 

Pr  ft Iptyn. oZ" i2i  1 

tf  lt»»9. 1-wli  |l>  t lc  te,-pr  elptyn . 90  j 
prelptrn. i3.o90l i 9O’.650/o3i| 
prplrfrn.i3.o3.  P30.ES0 
prplptrn. i3*prp|ptrn.o3 
pr»|ptrn.o3.i3.| 

ttlptrn. |.vl ILelptrn-prelptrn.  903 
Prelptrn. ,3.O90?  . 9SI .650/o1i  I 
pi-elptrn.i3.o1,  .919.650 
Pr  e | rtrn  1l.prplptrn.0l 
Pr  tlptrn.ol.  Hi  | 
prplptrn. Ilf  , ] , | 

! C9.c9ft.c9f.c99.c9h.d0.d0ft, 

cl0b.clZ.clZb.clZft.cl2f .ci29.clZh.cl 3. 

C I 3p.c 136>CPrn .p.n  ] ,p.n  Z.tPtP*. 

P.»9  ) -Ml!  Z 

If IPf in. 1 o 101 , .013.  35.000 
Wlpfrn.il.  n|0Zi  ,013,  35. 000 
Wf  iMpn.  i|t  o!03i  .013.  35.000 
l-f  iPfrn.  ■).  olOl  013.  35.000 
tiflPfrn.il.  0I05,  .013.  35.000 
l-flPfin.  i|.  0IO61  013  . 35.000 

•iflpfvn.il.  o|0?i  0.3,  35.000 

•*  f IPfrn  . , 1 ■ n ] 00  : .013.  35  000 
It Ipfin  1 |«  0109  013.  35000 

l-flpfrn.il.  0IIO1  .013.  35  000 

t-flrtin.  ||.  o 1 1 1 1 .013  . 35.000 
tiilpirn.  |).  o]  I3i  013,  35  OOP 
tulrirn  1-  ol  1 3:  Oil,  35.000 

Ilf  IPfrn.  1].  0]  11  .011,  35  000 

tulrfrn.  ||.  Ol  ISi  Oil,  35.000 
l-FlPfin.il.  Ol  16-  .011,  35  OOP 
l-flr-in  ||.  oil?,  .011,  35.000 
l-elPfin.il.  ollB,  .on.  35.000 

l-tlpfrn.il.  0 1 1 9-  .011,  35.000 
t-flffrn  i|.  o!30i  .011,  35.000 
tflPf-n  i|.  o!3l  .011.  35.000 
l-f  Ipfin.  i|.  ,133,  .011  35  000 

tiflPfin  ,].  o!33i  .011,  35.000 

tnl  Ic9-tt|ptrn.|0|.»u|  |c9 
t riu  Ic9'  I,  t |p.rn  30 1 

t.flrtrnolOI.,101  l/o30|  1 J,  950.0O0/o3i  I 
I “I  I c9*.|,i  |pt rn . 103- fu|  |c9« 
t mr |rO..|,f|otrn  303 

l-flp.rn.ol03.il03  l/o3 03.  I.  850  0OO/o3i  I 
Ini  Ic9f.|.»|psrn  103.fMl|c9( 
tnu lc  9f*  t f |pt rn . 303 

ti t |p« rn . 0 103*  1 103  l/oJ03.  I 850  0OO/o3, 1 

tul  Ic9n. I,. |p,rn.  101. ft,|  |c9, 

twulc9n.|.f  lptrn.301 

b»|p?^n. ol04. ,104, 1/0304.  1.  6S0.000/oZi 1 
twl I c 9h*b 1 Irsyn . 10S* fw] |c9h 
t»ulcDh.|.t|pfrn  305 

We|p«rn.olOS-i|0Silio305.  I.  850  090/o3>  I 

t“l lc IP-tilpirn  1 05* fw| | c 1 0 
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tug  |c  1 O*- V * 1 p»yn  306 

k*|p*>-n.ol06*  1 106: 1 'o306i  1 850.0P0/o2il 

tulle  10?*fwl  IclOf 

tug  I 10i*V  »«*•'»»’".  307 

kllPtyn  olO^T.lOPil/oSO?)  058  000/o2il 

(til  |C  l«b*k*|p®y"  100*ful|cl0b 

tug  le  10b*k»  Ip**"1  • 3^0 

k*|r*vn  o 1 00 <■  1 1 00 ' 1/0  3^0'  I*  050  000 /o2  1 
tul  Ic  l?*k*lr*yn.  109* ful  |d2 
tuu|cl2*k*lptyn  300 

k»|p»>n,ol09- i 109> 1 'o309  I.  BS0.0O0/o2il 
tulle  12b*  h * Ipfcm . 1 10*  ful |c 1 2b 
tuu Ic !2b*k »|p®rn. 310 

U*}ry:n  cllO-- ,110il/o3lO:  1.  950  000 /o2  1 
tul  lcI2a»t»lr*rft.  Ul*fullcl2* 
tk»ule  12»*k«  lt>»yn  *31 1 

lr»lP»Kf*.olll«>  111*  l/o3ll«  I.  KSO.  O00/o2 « I 
tul Ic I2f *kf |pf y*. I12*ful |c 12* 
t mu  I c 1 2 ( •'* 1 I Pf  yn . 3 1 2 

k * I p* vn . r 1 1 7 « 1 1 1 2 f 1 /o31 2*  1*  050  000/o2«l 
t ul Ic 12g*k* lp®*n.  1 13*ful  Ic  129 
t ug  Ic  1 29*1'  t Irty"  313 

k*|p»yn.oU3*  . 113  1/o313i  1*  050.00O/o2  1 
tul  | r 1 Zh*k*  | p»  yn  . IH*(wl|cl<^ 
tug | C 12H»k*  |p*yn  3H 

V*lr»>nolM-.  lit)  l/c3M«  1.  05OOOO/o2»l 
tul |cl3*k*lr®yn-  115* fullc 13 
tuulc  13*W*|r»>n.  315 

k*lr*»n.oll5-i 1 IS : l/o315  1 050  OO0/o2<l 

tul  Ic  l.li»*t»lp»yn- 1 16* ful  I cl  3* 
t uu  | c 1 3**k*  Ipfyh.  316 

k *|p»* n cl  16* 1 1 16; 1 /oai6-  1>  050.0O0/o2tl 
tul  |c  13b*kf  lr»yn.  1 p.  ful  |c  13b 
tug Ic 13b*kf |p»yn.  31  ? 

k-lrtyn  cl |?« . 117: 1 /o31 7.  1.  0500Oe/oZ  1 
tul  lcm«n*kf  |pf  yn  . 1 10*(ul  |C"»<n 
tug  |cm*n*k  * |pf  yn  • 310 

k* Ipyyn.c 1 10“  l 110  1/0310!  1.  050.000/o2l  1 
tlk|m»r>  l*k*|p*yn.  119*f lH»*n  1 
glk | mxn  l*k*|p»>n. 319 

k*|p*yn.oll9*i 119 i l/o3l9>  1 050  000/o2-l 

1 1 k | mvn  2*k*  |p*yn  1£0»  Mk  !•»'"  2 
ulk|m«n  2*k»|p*yn  320 

kf|r*y«.ol20-'l?0«l/o320-  1-  050.000/o2il 

tul  IcrKSi^l'llp**'0,  1 2 1 • ^ wl  |cp®*9 

tuu  lcn««»*k»|p*yn.  321  ( 
k « I r*.  n . o 121  * • 121 ; 1 /o32 1 1 I.  050*0O0/o2il 
t lk  lpf»9  1 *k  * | p»yn  . 1 1.2*  Mk  | pf  f 9 1 
ulk*e-y<r9  l*k»|r*yn.  322 

k«  Pfiyn.M22**122«l/o322i  I.  05O  0O0/o2il 
tl  ic*«tq  2*k * | r*yn , 123* Mk  | ps*q  2 
ul>lc*reg  Z*k® |p®yn • 323 
k«lr*yn.pl23»> 123>l/o323!  1.  85O0O0/o2il 
k*.lrtyn.  1 Z*k*  |p*yn  o2 
k * |p*yn  . c»2  - 1 2 ; 1 
k * |psye> . «2*  1 1 1 1 

» k*|c««9  lock*  c9.c9o.c9f  .c99*c9**-c!0. 

• C 100. cl  0b. c 12. Cl  2c. cl  2*.  cl 2f -c 129. 

» c!2b,c 1 3 .c 1 3o .c 1 3b .cw*n .•*«  l.«*n  2. 

• cr**9  pa*Q  1>P*oq  2 

k * |c  *»9 . * 1 *■  olOli  0. 3 • 25  POO 
btkf?  ij.  olP2'  0.3-  25  POO 

• |ctt?  .!■  o!03i  .0.3.  25  POO 

bilctt?  .!•  olO.i  0.3.  25  OOP 
kiUiiq . il*  ol05‘  0.3.  25  OOO 

bflcf*?.'|.  0IO6  0.3.  25.000 

tc...  il*  o 107  P.3 ■ 25  POP 

bf  Icitg.  1 1 ■ 0 100  1 0.3.  25  000 

b.kftg.  rl-  ol09'  0.3.  25  000 

bilc*c9  1 1*  oil"!  .0.3.  25.  POP 

.1*  0 1 1 1 0.3.  2S.OOO 

btkf?.  .1-  ol  12'  P.3.  25  poo 
b,|e.,o.  '!■  0 1 1 3'  «...  25.000 

t«|cfr^.'|.  oil.  P...  25  OOP 
Ulcf9.ll.  oils  P...  2S.OP0 
It Ic.cg  1*  n| IGt  o..<  25-000 
lilcigg  il"  nil7  «...  25  POO 
btlctt?  il*  oll0  0...  25  OOP 
b.lcttg  'I-  oH3  ®4«  25  POP 
lr  f | C f f 9 11"  0 120.  «...  2 5 ■ OOP 

btlcftg  .1"  0 1 2 1 1 .0..  25  P«0 


I. f | cf ■ 9 • . 1 ■ ol2Zi  P. . * 25  000 
bt|ctt?  '1B  0 1 23 1 0...  26  PP0 

tul  I c9* bp |c**9- lPl.fwl I c 9 
tu.jlc9.lt Ict.g.  3«1 

tficf«9  oiei-i lei  1 1 /oapi 1 1.  ..5.000/oZi 1 

tul  Ic9fbflef*9  102.lulk9t 
tuulc9t*bf  lc.f9.3P2 

btlcftg  0 1 or  • 1 1 or  1 1 /«•  302  • 1.  ..5  09P/o2il 
tul lc9t*btlcfC9 .lP3.ft.Hc9f 
tuu | c 9* .1. Icttg. 3n3 

b,|ctcg  oinj.  .IP3-I/03P3'  1.  ..SPOP/oZ>l 
Im1Ic99.I.»Ic.»9.1P..*m1Ic99 
tMulcOg.l-f let. 9 30. 

Ukt.9  0IO..1IO.  1 /o3P*  1 ..S.PPP/oZ'  1 

tul  |c9H.|.f lcfC9  105*fwllc9h 
t wu  |c9h*l.  f 1 cf»9  305 

w.|rt»9  o|05  .l«5'l/o3P5  1 ..S  PPP^iZ'l 

twl|cl0*l.flc*f9.1P6*lJllol0 
' uu  I clP'l.f  Ic  ffu  306 

Iflcff?  olOF- 1 106  1/oSOE  1.  ..SPO0/o2'l 
t ..1  Ic  1 Of* I f I c ft?.  107*  tul  | c 10f 
twulc  IPfFflc  ftg  307 

l»lcf«9.olP7.ll07il/o3P7T  1.  1.5.P('P/o2  I 

tul  1 v.  lOb'Ff  left  9 100-fullclOb 

luu Ic I0b*l e left?  300 

l>flcff9.C"IO0*ilo0'l /c«3O0 ' I-  ..S.P00/o2t  1 
tul le I2»6f lct*9- 109* <“1 Ic *2 
tMulcl2*Fflcft?309 

V 1 1 c ft  ? olP9* 1 |09i 1 /o 309 1 1 .1S.0OO/o2i  1 

tul  Ic  I2c-Vfkft9  - llO*<ui  Ic  12c 
1 uu Ic 12c*Ff left?. 310 

1. f kft9-ol  10» ' 1 IP'  1 7o310>  1 ..5  0P0/o2.| 

tul  IcIZfVflCft?.  Ill  *,w' k*2» 
tuulc  IZfFfkftg-  311 

bf left?- elll'i 111 ' l/o311 1 1-  <<i000/o2' 1 
tul |c I2t*bflcf t?. 1 1 2-*  wl k 12. 
tuuk  12( -bflctt?  312 

btlc»t?  oll2. .H2il/o312.  1.  .*5.PPP/o2'l 
tul  kl?3*Ffk.*9. 113*<wl  Ic12? 
tuuklZg-lflc  ft  9-313 

b 1 1 cftg.ol 13" 1 Il3i  I /o313'  1*  .15P0P/o2'l 
tulle 12b*b t left?. 1 I.*(m1 Ic 12h 
tuulcl2b.bflctf9.3M 

b*lcM9  0ll..'ll.'l/o3l.'  I*  ..5.PPP/o2'l 
tf.l  Ic  13-btlcrt 9*  H5‘Pul  le  13 
tuulc  13*bf  ICH9-315 

bt lc»t9Pll5.'ll5'l/o3l5'  I-  ..5.POP/o2'l 
tul  Ic  13t*bt  Icttg  Il6*<ulkl3t 
tuulc I3t*b  f I eft 9 -316 

btkff9  c.|I6.iU6'1/o316i  I .<S.PP0/o2'l 
tul  k IJc'.bflcft?.  1 |7*FmI  IclJb 

t uu  k I 3b*  b f left ?•  31  ~ 

bf Icftg.fl 12* • 1 1*) l/o 31 7 I.  *15.POO/u2'  I 
tul  |c**n*bflctt?  1 10* Pul  le»»n 
tuulct.fltktf.  310 

bt left?  ol IB* 1 1 10i 1 /o31B  1 ■ «.5.PPP/o2' 1 

t lb  |R*n  l.bflcff?  119*nu«*n  1 

u lb  I m«n  l*bf left?" 319 

bikft? . 0 1 19* .119: 1/0319'  I «.5  000/oZi  1 

tlb|n>*n  c*bf  Icft9- lZO'Mb  |mtn  2 

ulb|m*r.  2*b«  Ic  f .9- 320 

be lef ff.olZP. ' 120'  l/c>32Pi  I*  ..S-PPO/oZ'  1 

tul  I c e-f  *9*b  * I c ft9  12l..«l  lep.t? 

t uu Icpft9*bflc  f »9 • 321 

bt ksc9>pl21* • 121 1 1 /o32!  1 1-  ..S0PP/o2il 

t|b|p»»9  l*bf|cf*9  - 122* Mb  I Pf  f 9 1 

ulb|r»t9  l*bflctf9  322 

b t kf*9-  ol22*  . 122  1/0322'  1 ..5-000/oZ  I 

1 1 b I ptt 9 2*btlct.9.123*nUPft9  2 

u 1 b I pf t9  2*btlctt9  323 

bflcft?  ol23* ' 123' l/o323'  I.  ..5-0P0/o2  1 

b t Ic  f t ? - l2*bf left?  o2 

b f le t*9  o2“ 1 2 I 

b f left?  1 2"  ' 1 ! 1 

' prtkpol  Loebf  fbdftnt  .thduord  uord- 

uc  dfur  n . tur n ■ pbon  >c»«n .«»n  I .**"  2 
■cpftg.pft?  l.Pftf  2.t*9 
pr t | r pp 1 . t 1 “•  plPli  076 
prt  Irpol  II*  olPZi  .077 
prtl.pol- il"  olP3'  077 
pr  t Irpo  I • 1 1*  olP.  1 077 
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prtlfpcl  .87? 

pr  * Irpo  1 . 1 1 • o 1^6  $77 

pr* 1 r pc  1 • • 1 • o 107 1 .$7? 
pr  « I r ro  1 I 1 • f>  I O0 1 .077 
pr  • | r pfi  | . t I • ol09  077 

pr  « I r pp  1 . i 1 « ollO.  .077 
pr  c |rp«l . i !•  0 1 1 1 • 077 

pr  » |r  pp  1 . i 1 • 0 1 1 c • 077 

pr  c I r po  1 1 ■ 0 I 1 3 077 

t 1 It  | *hd»*r*t  *pr  v |r  pol  101  * f lk  | 

U U I fHdyyn \ *pr « |r pc  1 3#1 

prtlrrol  o 181  • • 101 1 1 /o30l  1.  31  0O0/o Z 1 

I It  I tHduor  d*  rr  • |r  po  1 !W*nM  fbdwor  d 
ulk  I thduor  d*pr  9 I r po  1 . 307 

f*r  1 1 r pn  1 . o 107*  * lOt  1 1 /o307  1-  3l  000 /oM 

1 1 1)  I wor  d-pr  ft  I ' po  I 183-flk|uord 
ulk  |»*>r  d*pr  * |r  pel  303 

l.-r  * I r po  1 o 1 03' < 1 03' 1 /c303  1 31  0O0/o2  1 

l IV  It  *d*urn*pry|rpol  . 101*1  II*  |wrd*ure 

ulk  |wr  dt'jr  A*tr  *frpt'l  ■ 301 

pr  f | r po 1 . o 1 01  • 101  1/o301i  1,  31  000/oril 

1 lk  |*urft*pr*|rpoJ  105-flMiurn 

ulk | fur n»pr| | rpol  305 

pr  # | r po  1 ■ 0 1 05  * 1 05  ‘ 1 /o  305  1.  31  009 'n2  1 

tlH  pHon*  pr  * | r po  1 • 1 f It  |pbon 
•J  I b If  Kon*pr  * (rpol  3^6 

Pr  * | r >>o  1 0 1 06"  ' 10t>‘.  1 /n1$6  1.  31  000 /o2  1 

t wl | r«»n» pr f |r po 1 ] 0 7«  f w]  | r, Run 
twu |c n* pr « |rpol . 307 

pr«|rpol  ol07»  1 |07f |/o307  1.  3l.00O/o21 

t ] b I m M n l*prf)rpol  lO0*#llr|»«O  1 
u 1 k ' ">  * n 1 * pr  f | r po  1 . 308 

l • • I r po  1 . 0 1 08 ■ 1 1 08 * 1 /o 308  1.  31  0O0/o2:  1 

lit  |w*n  2*pr«|rpol . 109*  Ml»  |P«n  2 
ulk|"»*n  2*  pr  # I r po  1 30$ 

prelrpol  .ol09«.  109:  l/c*309<  1.  3l.000/o2'l 

twl  |r.PftQ*pr  tlrpol  1 10* fwl  lcpf*9 

t wu  Icpf  « 9*pr  • I rpol  310 

pr  * | r po 1 0 1 10*' 110  1/0310:  1 . 31  W>0/o2' 

tlHpfff  1 *pr  1 1 r po  1 !ll*ut  jpttf  1 

ulk|P**9  1 * Pr  • I r PP  1311 

pr*  Irpol.olll*  111  1 /031 1 « I-  31. 000/02  1 

t lk  I Pf  *9  2*  pr  # |r  po  1 2 

U It  lP**9  2*prf  Irpol  . 312 

prf  |r  pol.  ol  12*  I 1 17  t/o312'  1.  31000/o2  l 

tit  | ««  <l-pr  f I r PO  1 113-1  1 1*  1 • •• 

U IV  I f »9«pr  • |r  po  1 313 

prt  Irpol  ol  13*  I 113: 1 /o 3 1 3 » 1*  31  000/o2  1 

prt  |rpol  ■ 2-pr*  Irpol  .0? 

pr  f | r po  1 0c-l2'l 

kfluv  1 *vk  | kt  luv-pr  * |r  po  1 . 901 

prflrpol  • i2*o901  • 37S/o3il 
prrlrpol  <2*o3  671 

prtlrpol.  i 3*prt  |rpol  o3 
pr  * | r po  1 0 3 • » 3 1 1 
pr  • I r po  1 i 3*  »1'1 

• k*|uv  Loci'*  cl  •c2'Cl'C6'c7.c7*,c7b  c8* 

• c9.c9*.c9f  c99  c9H.cl0.dO*.clOb. 

! cll.cll*cllb.cll*rCllf .CllS'CllH. 

1 cl2-cl2c  .ri2t.cl2f-cl2i.cl2b.cl1' 

• cH*-cHb 


t * 1 uv . 1 1 • 

■ 0 101 

031 

L*luv.  * 1* 

0 102' 

031 

ly | uv  • 1 ■ 

0103* 

031 

(••luv.  1 1 • 

olOI. 

031 

\t%  1 uv . Il- 

0 1 05  ■ 

.031 

L* luv. 1 1 ■ 

0 106 

.031 

l«  * 1 uv.  1 1 ■ 

o107i 

.031 

Lf luv. 1 1* 

0 1 08 1 

031 

L 9 1 uv . 1 1 • 

0 109 

031 

fcf luv. 1 1 ■ 

0 1 10! 

.031 

t* luv. • 

ol  11' 

.031 

L * 1 uv  '1* 

0112' 

031 

V*luv. 1 1* 

0 1 1 3' 

031 

k* luv. ' 1 • 

ol  11. 

031 

kf luv  1 1« 

0 1 15 

031 

k • 1 'J  v 1 1 * 

ol  16' 

031 

k*  luv.  1 !■ 

oil?. 

031 

k * 1 'J  v l 1 ■ 

one 

031 

k 9 1 UV  l 1 » 

0 1 1 9 S 

.031 

k * 1 UV  1 1 ■ 

ol20. 

831 

If  * luv . 1 1 ■ o 1 21  1 031 

Irtluv.  . 1*  o!22>  031 

l«  * luv.  1 1 • o 1Z3>  • 031 
k*  | uv.  1 1 • o 171  • . 031 
k*|uv, i 1*  ol2Si  032 
l* • I u v . . 1 • ol?6>  032 

** luv.  1 1 • ol27i  • 032* 
l»f  1 uv.  * 1 ■ o!78 ‘ • 032 
kf luv. i 1*  o!29t  .032 
Irf  luv . »!•  ol  30;  032 

Irf  luv.  1 1 • ol 31 1 032 

l-fluv  .1*  ol32  032 
twl I C l*k  y | uv . 101 » f wl Ic 1 

♦ w'J  |C  1 - l*  « lUV  301 

I) * | u v o|01**10|  l/o30l>  1.  131  000/o2'l 
twl  I r2*k  * luv.  107*  fwl  lr  2 
twu  Ic2*  l>  • I uv  3'V 

k«|uv  o!02-  » 107  1/9302'  1 131  O00/o2'l 

twl  |c1*k«  luv  | 03*  t wl  I c 1 
twu  ld*V«|uv  303 

l*»|uv  ol03» . 103: 1/9303  1,  131  0O0/o2'l 

twl  I C S- 1*  9 luv  104-f  wl  Ic5 
twu  Ic 5* k y | uv  301 

li  i luv . o 1 01  • ' 1 .'1  1 /o301 1 1 131.000/02-1 

twl  1 1 7*  k y | gv  105-fullc? 
tuu  It  7-lrf  luv.  305 

niuv  rl05«  >105'  1 'c305«  1-  l31WW/eM 
tul  lr  7a»l  • luv  l06*fwi|c?i 
t wij  | r 7%‘t  % | ijv  . 306 

W * I u v . 0 1 06  * 1 1 06 1 1 'o  306 1 1.  131  0OO/o2'l 
twl  It  7t>»  l>  * | u v . 107*fwl|c7b 
t wu  I c 7b*  i>  « | u v 30  7 

V » I uv  0107-.  107.  l/o307t  1.  131  008 /o2 1 1 

twi  ue-tf  luv  1 o0»  t wi  us 

twu  I r fl*  1.  « luv  308 

l*luv  clO0  108  l/o308  1.  131  000/02 «1 

twl  | c 9*V*  I uv  1 09*  f wl  |c9 
t wu I c9*Vs luv  309 

Vf«luv.ol09-  .109  l /o309:  1*  134.008/02' 1 
twl  Ir9**t*  luv  . 1 10*fwl  |c9* 
twu  Ic9**l-*  luv.  5 10 

t y | u v ol 10*i 118' 1 /o 3 1 0 • 1.  131.O0O/o2i1 
twl  Ic9f*muv.  1 1 1 • f w 1 |c9f 
twu|c9f*l>fluv.311 

l-y  luv  oll  l-illl  l/o3ll«  1.  1 31  90O/o2 » 1 
twl  Ic9s*lf*luv.  1 17*  fwl  | c ?9 
twu  Ic99*l'?  lu v . 317 

1-*Iuv.p117*i112:  I/p312i  1.  1 31  808/o2i  1 
t wl lc9H*W 9 | uv  113*fwl|c9b 
t w»i  Ic9h*i.  9 1 uv  • 31 3 

t*|yv.  oil?-.  113.  1/p313>  1.  131.800/o2M 
twl  |r  10*  l>  * I uv.  1 1 1*  fwl  |cl8 
t iiu  |c  10*  t *|uv  3 1 1 

b«luv  0 1 1 <*  . 1 11  • l/n311.  1 13l.000/o2«l 

twl |c 1 09* V* luv  1 l5*fwl | c10i 

t wu  I c 10**1'  • luv  315 

niuv  0 1 15- . 1 15'  1 /o  3 1 S * 1.  134 .000 /o2 1 1 
twl  |c  lOb-W*  luv.  1 16- f il  |c ieb 
twu |c I0b*l« s luv  316 

Leluv.ol  16-'  116'-  l/o 316:  1.  131.0O8/o2:l 
twl  Icl  l-Wf  luv  1 17*f wl  |cl  1 
1 wu Ic 1 1 -W  * luv. 317 

W* luv.ol 1 7 • * 1 1 7 1 1/p317i  1.  134.0OO/c2«l 
twl  | 1 la-l-9 luv.  1 18*  fwl  I c 1 1 * 
t wu  Ic  1 1 •*■!'•  luv.  318 

Vsluv  p118'  U8  1/p318:  1.  I34  008/o2»l 
twl  Ic  1 1 b-l'* |yv . 1 19*  fwl  |c  1 lb 
t wu Ic 1 lb-L  * |uv. 31 9 

Itluv.ol 19* « 1 19> 1 /o319«  1.  131  808/o2'l 
twl |cl 1 1 -V* luv. 128*  fwl |cl 1* 
twu |c 1 1 **W*luv. 328 

l*l-v.ol70«. 120  1/93201  1.  131  0O0/o2«l 
twl |cllf*W*luv. 1 2 1 - f w I |c 1 lf 
tirj  I c 1 1 f *L*  | UV.321 

lr*  I uv.  0 1 21  • 1 121 1 1 /o32 1 1 1.  131. 000/o2i  1 
twl |cl l9-k«|uv. 122- fwl |cl I9 
t WU  |c  1 l9*lr*|uv.  322 

Lf luv. 0 122* 1 122 1 1 /o322i  1.  Ijf808/e2il 
twl  |c  1 lh-l<*|uv.  123- fwl  Icl  lb 
twulc  1 lh*h t |uv.  323 

W*|uv. ol23* 1 123' l/o323i  1.  131  808/o2tl 
twl  I c 1 2- lr • I u .I21-fw1ic12 
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twic ir-tiiuv  374 

If  luv.ol?4.,|?4  l/o3?4t  I I34.0O0/O?,I 
t..l  Ic  l?r.»lt  luv  t^s-fwl  lcl?c 
tttu  tc  l?c*l  t luv . 325 

Ifluv  olI5*  1 125  I /e325 1 I 1 34. 000/0?,  I 
tM||cl?«.lt|uv.l?6*4Ml|cl?t 
I mu  I c I ?c*l 1 1 uv  326 

> iluv  ol?6"l?6,|/o3?6  I.  134. 000/o?t  I 
• '**1  Ic  124-ltlw  i??.4mI  lcl?4 
tMulcl?4*lt|uv.3?7 

Ifluv  oI?7.,|?7,  l/o3?7t  I,  1 34  000/o?,l 
tul|d?g*lfluv  I?S*4mI|cI29 
(mo  Ic l?g*l tluv. 370 

ltluv  ol?0"  |?0  l/o3?0,  I.  134  0P0/o7i  I 
tul Ic I2b*l t |uv. l?9*4ul |cl?h 
I mu Ic 1 ?h*l  t luv . 379 

Ifluv  ol79*  1 179  I /o3?9,  I.  I3f  «00/o?,i 
(mI lcl4-lt|Uv  1 30* ImI |cl4 
ImuIc 14*1  f |uv . 330 

Ifluv  cl30"l30t  l/c330-  I.  I34.O0O/p2i | 
(mI Ic |4#*tt|uu. 131 *4mI | c 1 4* 
tuu If  1 4 t*l t luv. 331 

If  luv.  cl  31"  1 31 ' 1 /o33l , I.  134. 000/07.1 
tMl|cl4b*lfluv.|32*fMllcl4b 
( m*j  Ic  |4b*lf luv.  33? 

Ifluv  o!3?"  132  |/o33?,  I.  134  000/o?il 
If luv.  ,?*f» luv.o? 

If  luv.o?*i?i  I 
If luv. I?*  1 I I I 

1 pcflffg  Loclf  crtfg.pffg  1-rifg  ? . f f g 
pcflffg  ll*f  olOl  .750.  35  000 
fcfltff.il*  olO?  .750.  35000 
pcflffu  1 1*  o|03  750.  35  000 

pcf  I f f 9.  , |.  0 ' 04  750  . 35.000 

( m I lerf  tg*pr  f | ■ tg. 1 0 1 * f m!  Icoffg 
( MU  I C Pffg-pc  f | f f g 30 1 

pCflfcg ■ 0 I e | - 1 101  1 1/0301 i I.  I 00 , 000/0? : I 
HHpftg  1 »pr  f I ffg  |0?-4|l,  Iptfg  | 
uHlpttg  l-prflug  30? 
pcf  I ffg.cIO?"  10?  1/030?'  1.  I00  000/O?|| 
( II IPffg  2*pcflffg  I 03*4  1 1 I pttg  ? 

ull Irttg  ?*pcf|ffg  303 

pcfltfg.o|03"  103'  1/0303  I.  ]00000/o?,| 

I II  I t*g*pcf | ffg  104*4 IV  I ffg 
Ull  I tfVpcf  |i#g.  304 

pcf I tfg. ol04* 1 104 , | /o304  |.  100  *00/02,  1 

pcflffg. ■ ?*pr f | ifg. 0? 

peg  I tog  o?* 1? 1 I 

lflftg.l*vl|lf  I ft  g-p*  f | f#g.  901 

peg l*#g. I?*o90l  l/o3il 

pcflffg  i3*rrf lfff.o3 

rrvlctg  o3*  » 3 I 

pcflffg.  ,3*  1 1 1 I 

1 If  If fg  Loci  f f *9 
Iflff*. 1 »I0I 1 I 
t II  If »g»lt I tfg  1 01  * f |l | tf g 
ull I tfg*l f I tog.  301 

If If*g  ol0l • ■ 101 1 1 /o3PI 1 !■  400  000/0? 1 1 
It  I tfg-  '?•! t Iffg  0? 

If  Iff*. o?* i?i I 
Ifltcg. i?*  ol02'  I 
( |l I t* g*l t |tgg. I0?.f |l |«fg 
ull I f fg*l t | ttq  30? 

1 1 1 tfg  0 1 02"  10?  1 1 /o39?  1 I.  400.000/03  | 

Iflftg  •3*ltlttg.o3 

It  I tog  o3* ,3  I 

I t Iffg. 1 3*  ol03  I 

( II Iffg-lf Iffg. 1 03*411 Iffg 

ull I ffg*lf Iffg. 303 

Iflf#g.ol03*  103  l/o303'  I 4pn  000/04  | 
Iflfrg  i4*lf |tfg.o4 
I f Iffg  o4* 1 4 1 | 

If Iffg  ,4*  o|04  | 

( II  If fg*lf Iffg. 104*411  Iffg 
ull I f cg*l t I f f g 304 

Ifltfg  3104*, 104  l/o304,  I.  400  000/o 5 I 
Itltfg  1 5*1 t I tfg  o5 
Ifltfj  o5*  5 I 
It  I tug. t5*  ■ 1 I 


1 pcfluib  Lorlt  c4.cS 
pet lutb. 1 1 o!0l , 500 

peflutb. , !•  o!02  500 

(mI Ic4*pcf |utb  I0I*4mI I c 4 
I mu Ic4*pcf |utb  301 

pr  f lutb  0 I 01  *,  101  I l/o30l  I.  50  000/o?,l 
tul Ic5*pcf lutb. |0?*4mI  |c5 
tMulcS*prf  lutb  302 

peflutb  O|0?*||0?1 1/030?!  I,  50  300 /o? 1 1 
peflutb. i?*pcf lutb.o? 
pet lutb. o?* , 2, I 

I* lutb. l*vl lit lutb* peflutb. 901 
peflutb.  ,?*o90l  0S7.6O/o3i| 

peflutb. i2*o3.  ,943.60 
peflutb.  < 3*prf  lutb  - o3 
pe  f lutb.  o3*  > 3 I 
peflutb.  >3*  , I , I 

1 1 1 1 u * b Loelt  C?.c3.c3f.c3b.c4.c5.c6. 

c6f .cR4 .c6g.c6h.c I3.C I3f.c 13b 
If lu*b. i|tf  0 101  0'| 

It lutb  I*  0 1 07,  071 

I f lutb  ,1*  0 I 03  .071 

Iflutb.  l|.  0 I 04  1 0-M 

Iflutb  ,1*  c 105,  07| 

Iflutb  ,1*  ol.'Gi  071 
Iflutb  .1*  olP7i  ,07| 

Iflutb. t|*  o 1 00 1 .071 
Iflu'b. , I*  o!09i  .07? 

Iflutb.  t I * 0110,  .07? 

Iflutb  I|f  Pill  .07? 

Iflu'b. 1 1 • oil?,  07? 

Iflutb  i I*  0113  07? 

Iflutb  I*  ol 14  077 

Im| I c7*lt lutb  101 • 4m| IC? 

•mu  |e.?*t  t lutb  31)1 

Iflu'b  g|0l"  I0|  |/o301,  |.  30  000/0?,  | 
ImI  Ic3*lt  lutb.  10?*4ul  1*3 
t mu  I c 3*1 1 lut  b 30? 

Iflutb  Ol0?.l|07:  |/o30?I  I.  30. 000/0?,  | 
tul  Ic3t* Iflutb.  I03*4mI  |c3* 
tuu Ic3«*lt lutu. 303 

If lutb  0103*. 103, 1/O303,  I.  30  000/0? 1 1 
tul  Ic  3b*lf  lutb.  104-ful  Ic3b 
tuulc.3b*lt|utb.3P4 

Iflutb  0104. ,104, |/o304  1,  30.000/o?,l 

t m| Ic4. Iflutb  I05*4mI  I c 4 
tuulc4.|f lutb  305 

If lutb. ul05* 1 105' I /03O5'  I.  30  000/0?, I 
t m I lcS*lf lutb- 1 06* 4m 1 1 c 5 
t w*j  Ic5*l  f lu*b.  306 

lflu*b. ol»6*t|06i  1/0306,  I.  30.000/o?,| 
t*,|  Icfi. l,|utb  I07*4mI  |c6 
t mu  I c6*  I f lut  b.  3*17 

Iflutb.ol07.i|07,l/o307i  |.  30  000/0  ? , J 
• u I Ic6f -Iflutb  |00*4m1 Ic6f 
t.ej|c6— Iflutb  306 

If lutb  0109*1 100, 1/0309,  I.  30  000/o?  I 
ImI Ic64*l ■ lut  b- I09-(mI|c64 
tMu I c 6 4 • I flutb  309 

I f lutb. o 109* 1 109, 1 /o309,  I.  30  000/0?,) 
t ul  1 1 6g*l  • lutb.  110-  4,<|  |c6g 
tuu Ic6g*lf lutb.  310 

If lutb. ollO'ilin, I/o3I0  I.  30. 000/0? 1 1 
(mI  |c6b*lolutb.  1 1 I*4mI  |c6h 
(mu Ic6b*lf lutb  311 

Iflutb  ol  1 1*  • II 1 1 |/o3l  1 1 I.  30  04’O/o?,| 

'Ml  I C I 3-1  f I ,j*  b 112*  4m|  1 r 1 3 
tMU I c 1 3*1 flutb.  31? 

If  lu'b  oil?"  II?,  l/o3l?  I 30  000/0?,  I 
tul  |c  1 3f* If  |,jtb.  1I3*4m|  lc)3f 
tMulcOf-lflutb  313 

If  lutb.oll3"ll3i]/o3l3'  I.  30.000/0?, I 
twl Icl3b*lflutb. II4-4mI |c!3b 
t *ej  I c 1 .3b- 1 f I ut  b.  31  4 

It lutb. o)l4*,||4, 1/0314,  1.  30  000/0?,  I 
Iflutb  I ?*!t lutb.o? 

Iflutb.  o?"2, 1 

Iglutb. ,?■  ol 15,  ,071,  30  000 
Iflutb. t?*  ol 16,  .071,  30  000 
Iflutb  i?p  ol  1 7,  071,  30  0PO 

Iflutb. I?*  0 1 10,  07|.  30  000 
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ktlutb. i2*  ol 19*  071.  30. 000 

kilutb. «2 • o *71 • 30. *00 
ktlutb. .2*  o!21t  .071,  30  000 
ktlutb.  i2*  el?Z>  .071.  36. *00 
ktlutb.  t2*  olZ3i  .072.  30  000 
ki|utb.*2«  ol24i  .077°  36  000 
ktlutb  . 2-  o 125  072.  30006 

ktlutb. i2»  ol2G  672  36  006 

ktlutb.  1 2-  ol27  672 • 30  666 
k t |u* b-  <2*  o 1 20  > 072 . 30  600 

tu| |c?-kt|utb  1 15*fnl I c 2 
t»«ulcC*kt  lutb.  315 

ktl.itb.oll5-.HSil/o3lS>  1.  150  000/o3  1 
t m1  lc3-ks|utb.  1 lG*f m1  1c3 
t mu U 3*ki  utb  315 

ktluth.ollS*  1 116>  l/o3l(t  1.  150  006 /o 3 1 
twl  |c  3i-ki|uth.  1 1 7-f m1 lc  3o 
t mu  I c 3o-ki lutb. 31 7 

ktlutb.Pl 1 7* ill?t 1/o317i  1.  15O.0OO/o3>  1 
t«l I c 3b-k  f Igtb- Ilt-fwl lc 3b 
two |c 3b*ki lutb  310 

kiluib.ol 1B« . 1 10> l/o31B>  1.  150  006 /o 3 1 
twl |c4-k*|utb. 1 19-fwl |c4 
tMutc<*kt|u«b*319 

ktlu*b  dl9*.119> l/o319-  1.  150.000/o31 
t m 1 Ic5-ki|u«b  120-fwlUS 
tMU  IcS-*  tlutb-  320 

kt|g»b  ol20*»120»  l/o320  1.  150.060/o3  1 

(m! |c6-kt|utb. 121*fwl IcG 
two  Ic6-kt  lutb.  371 

ktlutb. ol21*>121>l/o 32 1«  1.  l5O.O00/o3i  1 
twllcSt-kolutb. ir?*fwllc6« 
twulc  Go -kilutb.  372 

kilutb  ol22*«122il/o322»  1.  156.60«/o3il 
tMllc6f*k»|utb  123*fMl|c6f 
tnulcGf-kilutb  323 

kilutb. ol23-.123>l/n323.  1.  150. 006 /o  3 1 
1m 1 1 c6o*k* lut  b- 174-fMl Ic6) 
tuulf69-kt  lutb -324 

kilutb.  M24*.|74.  l/o324t  1.  lSO.0Ofl/o3>l 
tul  I c6h*ki  lut  b.  125-^mI  Ic6h 
twulc6h-ki  |gtb.  375 

kilutb. ol25*. 12S»l/o37S*  1.  15*  066/o3  1 
ImI  |c  13*ki|u»b  176-fMl  id  3 
t wile  I 3* k 1 1 u t b ■ 376 

k i lu* b . o 176* i 176> 1 /o326  1.  150  060 /o 3 1 
t m1  U 1 3i-ki  lutb-  127*fwllcl3o 
t mu  lc  13o-ki  | utb  - 327 

kilutb.  o!27*il27«  l/o327i  1.  15O  066/o3:l 
twlld3b-ki|utb  12B*fM||d3b 
t mu lc 1 3b-ki|utb-  370 

kilutb. ol20*tl20>l/o328t  1.  t 50. 000/o3*l 
kilutb. i3-ki|utb. r3 
k • | u t b . o3*  • 3 • 1 

kilutb. i 3*  ol79>  071.  36.606 

kilutb. 1 3*  o 1 30  * 071.  36.000 

kilutb. i 3*  p!3I«  071.  36.606 

kt  |utb.  i 3«  o 1 32 1 071.  36  000 

kilutb. i 3*  ol33i  071.  30  660 
kilutb. i 3*  o 134  671 . 30.600 

kilutb. .3*  ol35>  07|.  36.666 

ktlutb. i3*  ol36>  071.  36060 

kilutb. i 3*  o 137>  07?.  36.060 

kilutb.  1 3*  o 1 30  072.  36.600 

kilutb. <3*  ol39'  .072*  36  000 
kilutb  )3*  Pl40:  072.  36.660 

kilutb. l3*  ol41>  072.  36-000 

kilutb. t3-  ol42<  672.  36.000 

t m 1 |c2»kt  |utb>  129*  Jm I U2 
twulc2‘ki|utb.329 

kilutb. ol29*il29il/o3?9«  1.  156  066/o4>l 
twl  lc  3*ki|utb.  130-fMl  Ic3 
t mu  1 c 3-kilutb.  33* 

ki|utb.ol36*i 1 30* l/o 336*  1.  IS0  066/o4>1 
t m 1 lc3i*kf|utb.  131-fMl  lc3o 
tMulc  3o*kt  |utb  331 

ktlutb.  ol3I-il31t|/o33lt  1.  156.069/04  1 
t m 1 1 c3b- kilutb.  132-CmI  lc3b 
tM.Hc3b-kilutb.332 

kilutb. o 1 32* »132«  1/0332.  1.  l56  060/o4>l 
t m 1 lc4-ki|utbl33-fMl|c4 
t wu  lc4*k»  |gtb  333 


kt |u*b  ol33*t  133 • l/o333>  1.  150  O0J/o4  1 
t m 1 1 c 5 * * ilutb 134-fM| I c 6 
twu|c5-ki|utb.334 

kilutb  o 1 34* 1 1 34 1 1 /o334i  1,  150  t*60/o4il 
ImI Ic6»ki | utb. 135-tMl  IcB 
twu  Ic6*ki  |utb.33S 

k f Iutb.ol35*  i 135 1 l/o  335  I*  156  060/o4i» 
InI  |c6t*kt|ulb.  1 36- f Mi  |c6o 
tuu  IcGo-ki  lutb  336 

ki  lut  b o 136*  1 13€>  1 /*  336 • 1.  ISO  i4*0/o4  1 
tnllc6f*kflulbl 37*  f m1  |c6f 
tuu |c6f -k  t |utb. 337 

ktlutb. ol37-.137il/o337i  |.  15O.0OO/o4M 
till  |cG?-ki  | utb  - 130-fMl  |c6) 
t mu  Ic66-ki  lutb.  330 

kilutb- Pl30-il36>l/o330r  1.  lS60O0/o4  1 

♦ m!  |cGh»ki  | utb.  139-fM|  Ic6h 
Iwu  Ic6h-kt  | utb  - 339 

kilutb. o139*>139>1/o339>  1.  ISO  006/o4t  1 
t m 1 |c  13-ki|utb  MO-^mI  lc  13 
t mu  I c 1 3*k • |utb. 340 

kilutb- ol40* 1 1 40 > l/o 340-  1.  150  006/o4il 
tulle  13o*k  »|utb  1 4 I - f m1 | r 1 3i 
t uu I c 1 3«-k  s lutb- 34 1 

kilutb.  o 1 4 1 * « 1 4 1 1 1 /o  34 1 1 I.  150  060/o4il 
t m 1 1 c 1 3b- ktlutb* 1 42- f Mile  13b 
tMu  Icl3b-kt  | utb.  342 

kr |utbol42*il42il/o342i  1.  150  000/o4il 
k*  lutb.  s *»*kl  lutb  o4 
ktlutb.o4*l4ll 
k» lutb- « 4*  1 1 1 1 

1 C'-dPtt  loekt  c3.c3i.c3b.c7.c7o.c7b 

prtlpic  ll*«  olOll  166 

prtlpic. 1 1*  o 1 02 « 166 

pr t lp*c . i I*  o!03*  • 167 

pr  *t\p%r . 1 1»  o 104  i . 167 

prtlric  .1*  ol05>  167 

pr • | pie . 1 1 ■ ol06>  . 167 

tlil  | C 3*  pri  I pic.  161 -*m!  lc  3 

tiiulc3-pr«|ric.  361 

pr v Inc  . o 101  ■ 1 161 » 1 /o361  > 1.  56.000/o2«l 
t m 1 It  3«-pr*  |pic  102-fMl|c3t 
tuulc3fprt  |p»c  302 

prtlr/c  o 102*i 102il/o302'  1*  50  060/o2il 

tul  I c .3b-pr v | pic  • 103-fMl  Ic3b 

• m*i  lc  3b- pr  « | c*ic  • 363 

pre  Inc -o  103*  1 103: 1 /o303'  1»  S6.066/o2»l 
t m 1 1 c 7*pr 1 1 r^c  . 104- Cm|  |c7 
twu|c7*pr*|p5c  364 

pr • Ipse  ol04» i 164 i 1 /o364 > 1.  50-000/o2ll 
t M 1 If  7#*pr • I pie . 165- *m! Ic7l 
t mu  I c 7i*pr 1 1 pie . 365 

pr  * |p«c  • o 165*  > 165>  1 /o365.  1*  56.066/o2il 
t m1  |c  7b-pr«  Inc  »06-fM||c7b 
tt*u  lc  7t>-pr  « | p»c  366 

pr  t |p**c  . ol6£  il06  l/o366>  1*  50.000/o2il 
prtlnc  . «7*rrt  |pic.o2 
prt  Inc  . o2»  i2«  I 

klltttrch.  1 — vk  | k ■ | tetr  cb-pr  • | pic  . 901 
pri | pic . «2*o961 « . 130. 135/o3i  1 
kill  1 A*  . 1 - vk  I k 1 1 l l A**pr*|plC  ■ 962 
pr • |p*c  . i2»o90?i  . 130. 13S/o3>  1 
pr • |p»c . «2"p3'  .740.135 
prt  I pic  • i 3-prt  Inc  .03 
prt  | pic  • o3*  1 3 * 1 

prt  I PIC  • i 3*  1 1 1 1 

I k ■ | it  or  eh  loekt  c 2 . c 3 • c 3o . c 3b . c 4 . c5 . 

! c6.c6t  .cG*  .c6g.c6h.c7.c7t.c7b. 

\ c0-cl3.cl3o.cl3b 

k 1 1 itir eh.  1 1 o 1 4)1 1 .055.  50-006 

ktlttorch.il*  ol62>  .055.  56.000 
kl  liter  eh.  I 1*  o!03  055  . 50.060 

kllltorch.il*  ol04:  .055.  50-000 
kilitorch.il*  olOSt  .055.  50.606 
kllltorch.il*  olOfi:  055.  50.060 

ktlloorch.il*  oI07j  .055  * 50  000 
kilioorch.il*  olOfli  .055.  50.000 
kilioorch.il*  ol09i  .056*  60  000 
ktlioorch.il*  oUOi  056  * 50.000 
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fctlttercS.  U*  ol  11  • .056.  60  000 
kf IfttrcH.  I !■  oil? i 066.  SO. 000 
l>*  I s«r*r  r n.  1 1 - o 1 1 3i  0S6 . S0.OOO 
Pflft*rcK.il«  oll4t  066.  SO. 0<>6 
ktltftrcH.il*  ellSi  066*  S0.000 
kt|t««rcH.t|*  o 1 1 S ' 0S6.  S6  000 

kfltttrcK.»|«  ell?.  066  SO  000 
k v 1 1 1 1<  c k 1*  o 1 1 9 656  SO  000 

twl  cZ'-kfltttrrH  101  Wml  |r? 

twu  |c?*k»|fttrcK  30 1 

ktltttrCK.tl0l*.101il/o3Ol  1.  1160  006/o?.l 
1 wl  Ic3*k»|  tttrcK.  10?»fwl|ca 
t wg  1 r 1*  k f I ft t-  cK  30? 

ktitttrcK.oier*. ior, i/e3o:,  1,  noo  ooo/e?.! 

t m1  I c3t»kt  IfttrcH.  |03*fwl  |c3t 
tllO  lc3e*  ktlfttr  cK  303 

k*|fttrcK.ol03«  1 03 1 1 /o303  1.  1160  OO0/o?'l 
4 ••  1 Ic  3b*kt  IfttrcH  1 04 • f m 1 1 c 3b 
two  Ic3b*k«  If  ItrcK  304 

k»,l?rtrcK.ol04. .104:  1/0304  |.  1 1 60 . 000/oZ . 1 

tnl  I C4»k titter cH.  10S*fwllc4 
t wu I c 4»kf  | f t er  cK  30S 

kt!»terCK.olO6*.106  1/0306  1.  1 166. 690 /t?  1 
(»«1  lcS*kf|  f f trcK  106*fwl|cS 
t wu  | c S*  k 1 1 tftrcK.  306 

kfltttrcK  tlOC*  106.  i/03%.  1 1 100  000 /o 2 1 1 

twl  r6«k  1 1 fttr  C.s  10?*fwl|c6 
twu|cfi*k  t IfttrcH.  30? 

ktlfte  cH.ol0rr.107  I /o3*)?.  1 1106660/02)1 

t w] Ic6t*kf | tttrcK  100‘fwllcftt 
twu|c6t»kt  IfttrcH  300 

kulittrrh  Q100..1O0:  l/o300.  1 1160. 66C/o?i  1 

twl  1 C 6f  •ktltttrcK  10<Mwl|c6f 
twuic6f *kt IfttrcH  309 

kt  ItttrcK.  ol  09*  i 1 1 /o  309  s I.  1100  OOO/o?  1 

twl  Icfivkf  IfttrcH,  HO-fwl  IcS* 
t MO  I C 6?*k  f | ft  fr  cH . 3 10 

kflftvcH  0 1 10*  1 1 lOi  | /o3l8'  I.  1 190.  096/oZ>  1 
twl Ic6h‘kf  IfttrcH  lll*fMl|c6K 
twolc6K*kf  IfttrcH.  31  1 

kt|fttrcH.elll*illli1/o3lli  I.  1 160.00B/oZi  1 
twl  Ic?*kf  IftKcH.  1 lZ*fwl  Ic? 
t»)U  I c?*k»  IfttrcH.  31Z 

kt|fttrcH.o1l?*il1?i1/o3l?i  I.  1 160.  660/o?»  I 
twl  fcrt*kf  I tttrcK.  113-fwl  Ic?t 
two  |C?t*kf  | tftr  cH  313 

kt ItttrcH.ol  13*  * 113*  l/o313<  1.  1 106. 000/o?i  1 
twl  Ic  ?bfckt | tttr cH.  l]4*fw|  |c?b 
|wi.')c?b*kf  IfttrcH.  314 

kf  lsttr-h.oll1-.H4il/o314i  I.  1166  666/0?.  1 
tw?  I cB^kt IfttrcH.  lis-fwl  IcB 
two  I cB*-kt|  tttrcK.  316 

ktltttrcH. oll6*. 116  1/o31Si  1.  1160.66O/o?il 
twl  |c  I3fckf  lit ercH  l 16-fwl  lcl3 
t kKj|cl  3-kf  Ute-  cH  316 

kt|»ttrCH.oll6*  H6.1/o3l6  S 1166  666/0?. 1 
twl  |d  3t*>kf  IfttrcH  1 1 ?«  % Ml  let  It 
two |c I3t»k« liter  ch  3|? 

ktltttrcH. oil?*. n?. Wo31?i  1.  1160  660.9?  1 
twl |c I3b-kf IfttrcH. 1 lfl*f  wl |c 13b 
tiro  |cl  3b ‘•ktltttrcH.  310 

ktltttrcH. ol  18- . 1 1BI 1 /c3’ 6>  1.  U00.060/e?i  1 
kf  IfttrcH.  I?*kf  IfttrcH.  J? 
kf  IfttrcH.  0?*  •?>  1 
ktltttrcH.  •?•  0 1 19:  .66S  ?60  000 
ktltttrcH. i?*  ol?B.  .6SS.  ZOO  066 
ktltttrcH.*?*  0 I ? 1 • 0S6.  ?W  006 

kf  IfttrcH.  I?*  ol??.  OSS.  260.001.. 
kt ItttrcH.  i?*  ol?3.  OSS.  ZOO.  106 
ktltttrcH. t?*  ol?4i  OSS-  Z0O  006 
kt ItttrcH.  >2*  olZS.  .OSS.  ZOO  000 
ktlittrch.  »?*  o!?6.  OSS.  Z6O  O06 
ktltetrcH.  i?*  ol?**)  .0S6.  ZOO. 000 
k o f 1 4 tr cH . i ?*  olZB.  066-  ZOO  OO0 
kt  ItttrcH.  iZ*  o 1 Z9 1 0S6.  ZOO  OOO 

ktltttrcH  i Z*  el 30.  0S6*  ZOO. 000 

hi ItttrcH. iZ*  0131  0S6.  ZOO  000 

k f | fttr cH. iZ*  ol3?r  . 0S6 . ZOO. 000 
ktltttrcH.  iZ*  o 133*  6S6.  Z00  006 

ktltttrcH. .z*  0l31>  6S6.  ZOO  006 

ktltttrcH.  I z*  0l3S  0S6  ZOO  006 
k 1 1 tttr ch . i Z*  ol36«  0S6.  Z60.606 


twl  |cZ»kf  IfttrcH.  I I9*fwl  Ic? 

(wulcZ*k  t ItttrcH.  319 

kf  | setrcH.ol  19*  » 1 101 1/031S)  1.  1190  969.  o3<1 
twl  Ic3*kf  IfttrcH.  128‘fwl  |c3 
twulc3*kt ItttrcH.  3ZB 

kf  ItttrcH.  olZO-l  IZOl  l/uJZO)  1.  1 !00.000/o1i  I 
twl  Ic3t»kt  ItttrcH.  IZl»fuJ|c3t 
t wu  Ic3fkt  ItttrcH.  3Z1 

kf  IfttrcH.  o 1 Z 1 - 1 1 Z I • 1 /o  3?  1 1.  1100  OO0  A0 1 1 

tw|  |c3b*-kt  | tttr  r it.  !72*-fw1  |c3b 
twu  Ic3b-kt  | tttrcH.  3.7Z 

kt  IfttrcH. olZZ*llZZH/o3ZZi  I*  1160- 606  o3t  1 
twl  |c  4-kf  IfttrcH.  l?3»fwl  |c4 
twolcl.kf  IfttrcH.  3Z3 

kf  |tt«rCH.olZ3*  i IZ3.  l/o3Z?)  1.  1160. 606/03. 1 
twl  |c 6* ktltttrcH.  124-fwl fcS 
tt*ulcS*ks  IfttrcH.  3Z4 

ktltttrcH  OIZ4..1Z4, i/e3Z4.  1,  1160.669/93)1 
twl  Ic6»  ktltttrcH.  IZSWmI  |c6 
ti)')|c6*k*|  tttrcH.  3ZS 

ktltttrcH. o1ZS-)lZSI/o3ZS)  1.  1100.000/03)  1 

twi  | c6t*kf IfttrcH. l?6»fwl  Ic6t 
twu  | c6t*kf  IfttrcH.  326 

kt  lt*trCH.olZ6*  1 1Z6*  l/o3Z6i  1.  Ii60  600/o3.1 
twl  |c6f  *k*  IttercH.  127*  fwl  |c6f 

twulc6f‘kt|ttnrcH. 3? 7 

ktltttrch.ol2?*ilZ7)l/o3Z?t  1.  | |66.006/o3) 1 
twl  lcSq*ksfst»rcH.  1 ZR- f w 1 Ic6j 
twulc6g»kt ItttrcH.  3ZB 

kfltrt*  ch.olZB*«l?Bi  l/o3ZB.  1.  1160.666/o3)l 
twl  |c  SH*k  t ItttrcH.  lZ9»fwl  k6H 
t wu | c6H-kf ItttrcH. 3Z9 

kt  ItttrcH.  olZ9*.lZ9tl/o3Z9.  I.  1 166. 606/e3. 1 
twl  |c?-kf IfttrcH.  130‘fwl | c 7 
twg  | c7-kf  ItttrcH.  330 

kf  Itet'cH.  o!30*)130.  l/o330>  1.  1100  600/o3  1 
twl  | c?fkt  IfttrcH.  131-fwl  |c?t 
t wu  I c7t*-kf  (tttrcH.  331 

ktltttrcH.  ol31*)131)l/o331.  1.  1100.660/03)1 
tw’rlc  ?b»k*isttt  cH.  13?*fw|  |c7b 
twu|c?b*kt  ItrercH.  33? 

k f | tttr c h . o 1 3Z* < 132  l/o33Z)  1.  1160  060/o3il 
twl  |cB‘kt  | tttrcH.  1 33-f wl  |cB 
twu  IcB-kt  ItttrcH.  333 

kt | fttrcH. ol33* ♦ 133)  l/o333)  I.  1166.666/03)1 
twl Ic 13* ktltttrcH. 134*fw]  |c!3 
twu  Ic  13-kt  ItttrcH.  334 

kf  IfttrcH. 0134*.  134.1/0334.  1.  1160.606/03)1 
twl  |c  1 3t*kt  ItttrcH.  13S«fw]  | c 1 3t 
twu  Ic  13t»kf  ItttrcH.  33S 

kt  I ?ttr  ch.o!3S*  1 13S>  l/e33S>  1.  1166  666/o3'l 
♦ wl  I c 1 3b* k 1 1 tttrcH . 136»fw]  |c!3b 
twu  Ic  13t--kt  ItttrcH.  336 

kt  ItttrcH. o!36*)l36)l/o336  1.  1166.669/03)1 
ktltttrcH.  I 3»k  1 1 tetr  cH.  o3 
k 1 1 ttercH. o3*  1 3i  1 
kf  I ftt'  cH.  | 3*  i 1 I 1 

' kt  1 1 ee  locks  cZ  c3  c3t  c3b.c4.cS. 

c6-c6«.c6f  .c69.c6H.c7.c?t. 

■ c?b.c0.cl3.cl3t.cl3b 

k 1 1 1 ) me ■ ) 1 ■ ■ ol61)  OSS-  SO.  006 
k « 1 1 1 me . > I * olOZi  .OSS.  SO  OOO 
k « 1 1 ) me . 1 1 ■ o 163)  OSS.  SO  OOO 
kfltief.il*  o 104 i .06S.  SOOOO 
kfitift.il*  olOS)  055.  50.006 
k f 1 1 i i»t . 1 1 ■ 0I661  • OSS . SO . 666 
kfltiftil*  o 1 6? i -66b  SO  OO0 
ktltift.il*  olO0«  -OSS-  SO. 000 
kfltift. il*  ol09)  .0S6.  50006 
ktlt itt  1 1*  el  16*  OSf  SO. 000 
ktltife.il*  ollli  6S6  SO  000 
ktltift.il*  o 1 1 Z i . 6S6.  S6.006 
kfltift.il*  ol!3i  . 0S6 ■ SO . 600 
fcfltiff.il*  o 1 1 4 » . 0$6 . SO . **00 
ktltift.  M*  ollSi  . 0S6.  SO. 006 
kthift  il*  oll6*  .6S6.  SO. 600 
kslttft. il-  o 1 1 7i  0S6.  S6.000 
ktltift.  M*  o 1 1 8 1 6S6.  SO  000 

twllc  Z*  ktltift.  1 61  *-fw||c2 
twu lc?*kt  1 1 »ft  301 

ktltift  ol91*il91il/o39h  1.  ZZS  606/oZi  1 
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(m1  |c3*ktlURR.  102*1*1  Ic3 
t wu  I c 3*k  • I ( *•«  3rt2 

ktlt  irc.o 102*i  IOC  i/o3Mi  1-  22S  0O0/o2<l 
ImI  |c9**k«|t  IM  103‘fwllc3t 
• (wy  lc3>*kt|  1 iRt  303 

|rf  |(  irc ■ o!03* i 103>  l/o303  I*  225.W»0/o2.1 
ImI  |e3b*ktlt*»c  104*fwl  Ic3b 
(wylc3b*kt|(  • ••  • 304 

|r  • | ( Im  o!04*i  IMi  l/o304i  !•  225O0O/o2il 
(wl  | c 4 • Ir « 1 1 1 «•  105*fw1  Ic4 
twulc4*kt|t  irc-305 

kt | t irc . MOS* i lOSi  1 /o305i  I*  22S.000/o2  I 
tut  I c 5 *k  * 1 1 • rc  • IW-ImIIcS 
(wy  |c5*kt  1 1 irc. 306 

ktK  .»•  . 0 lOG*  1 10£<  l/o306  I.  225  eOO/o2'  1 
(mI  cG*ktl(lRt  l07*fwlU6 
(wy  I c 6-1*  • I ( irc  307 

kt  It irc  ol07»i 107i l/c307f  I*  225  000/oZil 
(mI  |c6c-kt  |(.rc  I09*lwl  l(6t 
( wy  I c 6c  • k f 1 1 1 »c  3°0 

ktlt.RC  p|Ofl,,|O0  l/o3O0  1-  225. 000/oZ' J 
(m!  |cfit*k*|t irc. 109*(wl I c 6f 
(wy|c6f*k»H  • rc  3°9 

kiK M*#.oie9»iie9«i/o3<v3i  i.  225.eee/o2»i 

(m|  I r 69*1 » | ( t*t  UO*fw||c6t 
♦ wy  lc  6c*k  « I t irc • 310 

kt|<  -»•  Olio.. lie.  1/O310.  1.  225.HOO/02  1 

(mI  lc6H*kt 1 1 t»e  1U*(m1|c$H 
twy  |c&b*kt |t  311 

k*|(  i»«  .otll*'Uli  Wo311>  1*  225  WO/o21 
(mI  |c?*k§|  t irc-  U2*Im|  |c? 

I mo  Ic7*(»|(  tew.  312 

kt  It  irc.o  H2*i  112'  1/o3I2>  1.  225  0W/O2-1 

(wllcrwkf  It  IRt.ll3*f"IIC?C 

(wy |c  7#*kt | ( irc  313 

k • M • oil  3*  r 1 1 3 < I /o3 1 3 1 I.  225.eee/o2il 
tail  |C2V-k*|t  irc  114*lwl|c7b 
(wy  lc  7b* kf  1 1 irc  3M 

kt  1 1 irc .ol  14*i 1 1 4 1 1 /o 31 4 • 1>  225.eoe/o2.1 
(m!  |cB»kfl  ( irc  ll5*fwl|cB 
twy  Ic8»k«|  t IN.  315 

ktlt  i**«  oI15*i115i1/o315i  I.  225  We/o2il 
(m!  lc  I3*kt|t  irc  1 1 6* f mI  I c 1 3 
(wy lc  13*kf 1 1 316 

ktlt irc  ol 16*' 116  l/o3l6*  I*  225  000/o2  1 
twl  |cl3t«kt !(•••  11 7. fwl  Icl3c 
tuulc  I3fk  t|  1 irc  317 

lrc.lt  irc.oI1?*i117iI/o317i  1.  225-000/02  1 
ImI  I c 1 3b*k fit  llB-fwl  Icl3t> 

(wy  |c  1 3b*k t I ( 31B 

* 1 1 1 irc  0 1 10*  • 1 1Bi-1 /o31Br  I.  225.eee/o2*l 
ktl t IRC-  l2*k»|(  IRC  o2 
kt  1 1 IRC-o2*l2l  1 
k • 1 1 1 rc  • 1 2 ■ 0 1 1 9 • ■ 055  • 29  000 
ktlt irc- >2*  ol 20 1 055  . 29  00© 

k 1 1 1 • rc  ■ 1 2*  ol2li  • 055  • 29  • 
k 1 1 1 » rc . 1 2*  ol22i  055-  75. 0°° 
k 1 1 1 * rc . 1 2*  ol23  055.  7*»  000 
k 1 1 1 1 rc  1 2*  0 1 24 1 095-  2'j  OOO 

k 1 1 1 1** • '2*  ol25  • P55  . 29-000 
kiltiN-i2*  ol26*  055.  75  000 

k • I ♦.  irc • • 2 • 0 1 2 7 1 099 . 79 • 000 

k 1 1 1 Mat  ■ 1 2 • 0 1 2B 1 056  ■ 75  - 000 

kt  It  ••*.  .2*  ol29-.  056.  7S  000 

ki|(  in-  <2*  ol30i  096  . 79-000 
ktl t fiat.  i2*  ol3li  056  . 29.000 
ktl(iia«.i2*ol32'  . 056  • 29 ■ 000 
kt  1 1 1 rc  1 2*  ol33'  .056  . 29-000 
ktl(iam.i2*  0 1 34 1 056  . 29-000 

k 1 1 1 1 rc  . 1 2 • 0 1 35 1 . 056 . 75  000 
ktltiam  «2*  ol36'  056  . 79  000 

(Ml  lc?*kf|t  irc . 1 19-0M1  Ic2 
(wy  Ic2»ktl(  mn  319 

ktlt  •*t.oll9*'ll9'l/«319i  1-  225.000/o3il 
(wl  Ic3*kt  It  .N-  1 20* twl  I c 3 
1 wy  | C 3»k  1 1 ( IRC  320 

ktlt irc. ol20**l20  1/o320i  1.  229-000/031 
(wl  IcJfkt  It  IRC  121*twllc3c 
t wy  1 c 3c*k  1 1 1 IRC.321 

ktlt* n 0l2l*>12l« :/0321»  1.  229 • 000 'o 3 I 
twl  Ic3b*ktlt  IRC  I22*tw|  Ic3b 
twy  Ic3b*kf  1 1 IRC  322 
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wit,..  i/o3::.  I.  225  w/oJ'i 

I23*fwl|c1 

t wu I c i * V • |t • 32 3 

k.|t  ol23'  123  1 /o3T3 ’ !■  225  W0/o3  I 
tul |cS*V* I t I24*<mI ltS 
ImilcS'V  tit  '«*  324 

V,|t,M.ol24.tl24  1/0324.  I.  22S  9O0/O3.I 
Ini  Itfi'V.lt  ,**  125'tul 1£® 
t,nj|c6'V»|t  '«•  325 

' w,|t...  oi:S.il2S.I/o3?S.  I.  225.800/o3,l 
Ini  US**^*lt  JT6*  f m1  Ic6* 
t.«u  U6.'Vtlt  >..  326 

V,M,..oI26..  126. 1/0326.  I.  27S«**/o3,l 
tnl  | c6< >Vtlt  >»*■  I2?»M  U6» 
tuulc6<'V»|t .*••32/ 

k,|t,„.  ol22*. 12 ‘.l/o32/  1.  22S.«W/oJM 

tul |c6t*V»l t ...  128'4ullc6t 
t uu  IcGfVtl  t .**■  3t 8 

V, It. ».  OI28-.  1281/0328.  I-  225.***/o3:l 
tul  lc6b.V»lt  ,w.  I29'*wl|c6b 
twulcBb'ktlt  .»•  329 

V, It. »*  ol29*. 129.1/0329.  I.  22S  «<#/o3  I 

tul  |c7-V«l  t .*•  I3**,“l  10/ 
tuulc7'V»|t  .*•  33.' 

k.  1 1 ,.. .ol 30"  il>'il  /o338  1.  22S.088/O3.I 

till  lc  ?•  * V . 1 1 .<■>•  131'lwl  lt?t 
tuulc/«>k»lt.»»  331 

b , It  . m-  ol  31* . I 31  l/o33l  1.  226  OW/oS.t 

tul Ic/b'V.ll,..  I32''.illc/b 

twule'b'Vtll "*•  332 

k.ll.n,  0132*. 132. 1/0332'  '•  2‘s  eC^/03' t 
t ul  I cfl'V«lt  >■•• ' 33'<“l U8 
luuIrS'Vtll  ,»••  333 

k « 1 1 . »*."133>.  133  1/0333-  1-  22S  (W/o3.1 
tul  |cI3‘V« M '*•■  134*4*1 Ict3 
lw>j|cl3'V»|t  ,»•  334 

k.ltmo. 0134. ,1J4.1/o334.  I.  22SW/o3'1 
tul  |cl3.'Vt|t  .*•  136- full'. 1 3* 
t uu I r I 3»'V»I t >»•  33S 

k.lt.n,  ol 36',  136  1/0336  1 - 225*0*/"3  I 

tul  lc  13ti'W*lt  ,»»•  I36*<ul  Id 3b 
tuult  I 3b-k.lt  ,«•  336 

k, It, ».  0136' ,136.1/0336,  I.  22S.0M/o3  l 
kt  It  ,»•  . 3'ktl  t ,*•  o3 

V t |t c*3* 1 3: 1 

|rf  |(  i>*»  >3*  1 1 1 1 


i Lexicon  locV  IV l*-n  2 
f | |r  | *.n  2- |V  | M*llM"‘n  2 
IV  |et.n  2 Z*ulV  I**"  2 

2 * »?'  I / ol  • I f 

Alt  ulH""*n  2 queue  • 1 8*9  • volil 
Sched  nonce*  U ?**n  2 
Collect  not! et  IV  l»*n  2 

• Lexicon  loci'  lV|pt>on 
( lH phon*  IV  | phon  . 1*1  IV | phon 
IV | phon . Z*ulV | phpn 

1 V | pho n 1 1 •»  • Z • l / ol i 1 / 111* 

Att  u IV  | phon  queue  1AA.  volil 
Sched  nonco*  lVIphon 
Collect  noetei  lV|phon 

i Lexicon  locV  lVIeuxn 

f IV  |eurn*lV  leurn.  l*t  IV  |*urn 

IV  I fijxx*.  Z*ulV  leurn 

IV  leuen.  1 1»«  » Z • 1 / oM  / * t » 1 

Alt  u IV | eur  n queue  IAA.  volil 
Sched  nonco*  IVIfjrn 
Collect  nottet  tHeurn 

• Lexicon  locV  11  Iwrdeucn 

ftk  tud|.jr»‘IHud|.J,»  1 • t IV  |ur d«ueo 
Ik  |m*  d.urn  2'ulV  turd.1-,", 

|k  luf  d.'j'  n ■ > 1 "•  .2,1  / ol  1 / ,1  I 
Att  y|V  |urd.urn  ou.u.  I**!'  v0'  l 
Scb«d  nr.nco»  Ik  | u*  d'u", 

Coll.ct  no.ttt  lk|ufd»ve» 

* L.»«con  lock  Ikluo'd 

(|V  Iuord*  IV  iuord  I'tlvluord 
|k  Iuord.  2'ulV  I mo' a 
|k Iuord  . 1 ,2,1  / oi  l / 1 1 1 1 
Att  ulk luo'd  ou.u., I**-  vol  , I 
Scb.d  noneo.  Ik Iuord 
Col  l.ct  ooklol  n luo'd 

" |oeV  Iklohduord 

( in  thduor  d'  I H *V>di,or  d I • U V I »l>4uor  d 
lk|»hduord  2'ulk I fhdup' d 

|k  |«Muo'd.  " I'*  ,2,1  / ol  I / HU 
At  t ulVItAduord  ouru*  100-  wol'l 
Sel.*d  no or.o*  lkloAdun'd 
ColUC*  nO»ttt  Ikl.Nk.O'd 


1 Lex'con  locV  IV |»e^ 

MV  jj»q*|V  lee?  MIV  1**9 
l V | tt?  t*ulV I »e? 

IV |»ei  i ’ Z ‘ I / o\  t / ' t 1 1 
AM  ulVIee?  queue  1^  vol'l 
Sched  nonco*  Ulte? 

Colte-  t noete*  IV  lee? 


i Lexicon  locV  lVIehdeent 
f IV  |«hdien»*iv  lehdeent  1 *t  lUehdeent 

l V | fhdeent  Z*ulHehd«e.-»t 

lVIehdeent . i 1 • '?l  / o*'1  / 11,1 
AM  ulV|#hde*»nt  Qvseue  > 1 00 . volil 

Sched  nonco*  IVlfhdfent 

Collect  not*. At  lVIehdeent 


1 Lexicon  locV  IVIreeo  1 

f IV  I pee?  l*lVlpee*  l l*tlV|ptes  l 

IV Irer?  1 .Z*ulV lr«e?  1 

IV |pee?  l.il ••  2 1 / ol 1 1 / 1 i 1 * 

Att  ulVIpeeg  I queue  1^0.  vol  l 

Sched  nonco*  lV|pe»3  I 

Collect  nretet  U Irte9  t 

1 Lexicon  locV  IVIree?  2 

f IV Ireeg  cfcIV I pee?  2 1 * 1 1 V I pee?  2 

|V 1p«c?  2 Z*ulVlpe*9  2 

tv | pee 9 : 1 ol't  1 'l  l 

AM  uivipee?  2 queue*  1^.  vol  l 

Sched  none')"  lV|pee?  2 

Co  1 ler * noe»e»  IV |pee?  2 

i Le*’Con  loM  IV  |»»n  1 
MVl»*n  t*lV|»*n  1 l*tlV|»x"  1 
IV l*»n  1 . 2*u IV |»*n  1 
U | n*n  1 il'1  • Z ' 1 /oil  / 1 t 

AM  ulVlmxn  t queue  1 ■ vo  t t 

Sched  nonco"*  IV  l«»n  l 
Collect  noetet  IV 1 


1 Cl  word^w^deurn 
feel  lct*wtct  . t*twl  let 
WUC  t • l*<wuld 

t )V  lMrd«ufn*wlcl  2*  1 1 V Imt  dtUr  n 
u l V I Mf  deunn»wuc  1 2 
1 1 V I Mf.x  d*  w l r l 3*flHMord 
uiv  |6d«r  d*uuc  1 3 

ulct  i|"*o2  1/  ,2,1/  03  1/  ,3  1/  Ol  1/ 
uud  . , l'*02,  1/  o3  1/  , I I 


, 1 . 1 


Attr  ,but.  vklk.lolo  Ou»u.  26*-  Voluoo,  *■ 
Attr.but.  vVlk.lc.*.  26*.  VA,lu^  * o*  •'■ 

Attr, but.  vklV.lP.'"  9.-V  Uolv^  » Od.r" 

Attr  , but.  vHV.lSIAPC  Ov.v.  25*.  Volu«  , 

Attr, but.  vkIV.I...  Ou.u.  260.  Volu*.  * 0^.' 

Attr  , but.  vklV.lt,..  Ou.u.  26*  - k/olu^,  e O*1" 

Attr  , but.  vHk.lutb  Ou.,1.  250  Voluo*.  ? ■J5*1"' 

Attr, but.  vVIV.lUV  Ou.u.  26*  • Wlu^  *■  0>\»' 
Attr  .but.  100X61*1.0  >,.U.  260.  Vol u*.  * °*  .r 

Attr, but.  I0XX6IX5C  Ou.u.  250  VoUd*  ^ 

Attr  , but.  lOOXtlXS/N  Ou.u.  76*  Volu*.,  * Wl*r, 


AAA . StertuP 
AOA  St  ex  t up 
AOO  Stprtup 
,000.  St  ex  tur 
PAO.  St  ext  up 
AAA  StectuP 
AAA  Stprtup. 

, PAO  St  ext  up 
AAA.  StprtuP 
AAA  St  px  t up 
AAA  St  px  t up  i 


AAA 

AAA 

AAA 

AAA 

AAA 

AAA 

AAA 

AAA 

AAA 

AAA 

AAA 
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Attribute  IQPAUfPOl  Queuet  Volumei  *,  Deleyi  AOO  St*rtup  , 

Attribute  TOPAClSEG  Oue>ae>  ?S8-  Volume  A.  Deleyi  AOA.  SteMupi  W6 
Attribute  TOPPC  I TUT8  Queue i ?S*.  VMu«ei  A,  Oeley  808,  Stertupi  008 
corr  wlcpee* .ulc**n,w]c7.wlc3.wU4,MUS.wlc6.wlc7,w1cB.wlc9.wlcl«  i wlcl 
copy  wuepee9.wu(m»n,tnjc?.wuc3.wuc*.wuc5.wuc6.wuc7.wuc0.t«uc9.Muclf  i wucl 
Copy  laid  1 .wlcl?. wlcl3.wld*. wlcl**. wlcl*b.wlcl3e.wlcl3bulcl?e  i wlcl 
copy  wuc  1 1 .wuc  1 2 wuc  1 3.  wuc  14  wuc Me -wuc  Mb • muc  1 3t.wue  13bwuc)?e  i wucl 
copy  mIc  l?f  .wlcl?g.Mlcl?h.iildle,wlcllb.wlcllt.wlcllf  .wlcl  If  i wlcl 
copy  wuc  l?f  -muc  1 tO.iKjc  l?h .wuc  1 1 e.wuc  1 lb -wucl  le  .wuc  1 If  .wucl  If  i wucl 

copy  wlcl  Ih.ulclAe  wlcl0b.wlr9e.wlc9f  .wk9f.wlc9h.wlc7e.wlc7b  i wlcl 

copy  wuc  1 lb. wuc  lOe -wuc  10b  .wuc9e .**;c9f  >wuc9f  •wuc9h.wuc7e.wuc?b  i wucl 

copy  wlc6t  wlc6f  wlc69>wlr6h .wlc 3e> wlc 3b  < wlcl 

copy  wuc6e  .wuc6f  wuc6g  .uucSh.>*jc3e.wuc3b  • wucl 

ecHed  noncompete  wlcl. wucl 

Coll  "oe<  et  wlcl  .wuc  1 


1 cree9  p«eg  ? 4 peeg  1 

fwl I creeg*wlc pge9  l*twl  Icp««9 

wuepetg  1 *«  wu  lcp»eg 

tltipeeg  1 *wl cpa*9  2- fit  Ipeig  1 

uU’lpeeg  1»wucpeeg.? 

tHIreea  ?»wlcpeeg.  3*f  It  Ipetg  2 

uH  Ireeg  ?»wucpe«9.3 

ec^ed  nnneompett  wlcpee| .wuepeeg 

collect  noetet  wlcpteg. wucreeg 

• cm»n  m<n  2 * m*n  1 

fwl  lcmrn«  wlcm»n.  1*  t wl  fc**n 

wjc*«in.  l*twij|c*yo 

tH  |i*n  l*wlcm*n  ?*flt|m*n  1 

u It  I »vn  l »wucmsn . 2 

t It |mvn  ?*-wlc"«n . 3*f  It  |**n  ? 

ult|**n  ?*wur*-<n  3 

»rt>ed  noncompete  «lc«*n .wuc**n 

collect  noetet  wlcmrn. wuc»«n 

1 c?  c 1 4 euro 

fwl|c?*wlc?  lMwlIc? 

wuc?  l»twu|c? 

tit  I eur  n»wlc?. ?*f It  1 %\jr  r 

ult I Our n*  wuc  7 ? 

twHcl*ulc?.3*fwllcl 

t wu Ic  1 -wuc?  3 

• ched  noncompete  wlc?  • wuc? 
collect  noetet  wlc?. wuc? 

1 c 3 word  • c 7 
fwl Ic3»wlc 3 l*t«l |c3 
wuc 3-  l*t  wulc 3 

twl  |c 7*m1c 3.?*fwl ♦ c 7 

t I c 7 • muc  3 • ? 

t |t  | wnrd*wlr  3 3*  f It  | wgr  d 

u It  | wor  d*uuc  3 3 

grh#d  nqncompe^e  k>  \ 3-wuc3 

collect  noetet  w1c».muc3 

* C*  wrdiurf*  • cf 
fwl|r4*wlC4  l*tw]  I C* 

* . 1 * t MU  |ct 

twl  . cB'  wlc*.?’  fwl  Icl 
t *hj  I c 8- wuc  * ? 

t It  |wr  diurn»ulct  3*  f 1 1 | wr  dfur  n 
ult I wr deurn* wuc * 3 

ecNfd  none  ompe  * • wlc*  wuC  * 
collect  noetet  wlc*. wuc* 

' cS  k^deurn  • »urn 

f«l  lcS*wlcS  l*twl  Ic5 
w uc  S 1 * * wu  I c 5 
t It  | « Ijrn»wlc  S ?•  f It  I lurn 

u It  | Vjrn*wjc5.  ? 

1 1 1 I deurn* mJcS  3*  f It  | wr deur " 
ult  |kjr  deurn*wucS  3 
ecK#d  noncompete  wlcS  wucS 
collect  noetet  wlcS.wucS 


' c6  c0  ♦ cl? 

fwl  Ic6*-k1cG  I *twl  lc6 

wuc6  1* two tc6 

twl  Ic  l?*wlc6.?*fw|  |d? 

twulc  l?*wuc6? 

twllce*w)c6.3-rwl|c8 

twu|cB*wuc63 

eched  noncompete  w)c6.huc6 

collect  noetet  wlc6>wuc6 

' c7  eurn  ♦ c!0 

fwj  | r 7*wlc7 . lMwl  f c 7 

wuc 7 1 • t wu | c 7 

twl  |cl0*wlc7.  ?*fwl  |d0 

t wu  I c 1 0*^wuc7.  ? 

tltti  r n*wlci\  3*f  It  |eurn 

u 1 * l»i 'n*wuc7.3 

fc»«ed  oncompete  wlc?*wuc? 

collect  noetet  wlc?«wuc7 

1 C0  turn  ♦ pbon 

twl  I c 8*- wlc 8 l*twl  |c8 

wuc 8.  l*-ti«ulc8 

t It  |phon»w)c8-  ?*tlt  IwHon 

ult lpbon*wuc8  2 

t It  Ieurn»wlc8  3* fit  leurn 

ult | eur n»wuc 8*  3 

erhed  noncompete  wlcB.wucS 

collect  noete1*  wlrB,w<>c8 

1 c9  pHon  ♦ cl? 

fwl  |r9-wlc9  lMwl  | c 9 

wuc9-  1 * t*au  1 c9 

twl  Id?  wlc9.?‘fwl|cl? 

twulc l?*wuc9  ? 

t It  |phon«wlc9.3*'f  It  |phcn 

ult |phon«wuc9  3 

echtd  noncompete  wlc9.wuc9 

collect  noetet  wlc9.wuc9 

1 c 18  ohon  ♦ c»yn 

fwl  Ic  19*-w1c  18.  l*twl  Ic  18 

wud9. 1-twulclO 

twl lc*rn*wlr|8.2*fwl lemyn 

t wu I cm vn • wuc 1 8 • ? 

t It  |phon«wld8 • 3*f  It  Ipbon 

ult | phon^wuc 183 

erhod  noncompete  w1cl8>wucl0 

collect  nnetet  wlclS.wuclA 

' ell  cm*n  ♦ cl* 
f.illcll*wlcll  iMwllcll 

WUC  1 1 . 1 • t wu Ic I 1 

twl  Ic  l*‘Wldl  ?*fwllcl* 
twu Ic 1*’ wuc 11.? 

t**l  lcm»n«w)dl  3*  fwl  Icmwn 
t nu Icm^n^wuc 113 
tct'td  noncoieoete  wlcll.wucli 
Collett  noetet  wldl.wudl 

1 cl?  (■’«  ♦ epeeg 

fwl  lcl?*wld?-  l*twlld? 

wuc  1?.  \* 4 wu  |dj 

twl ‘epeem* wlc 1?- ?*fw| Icpe«9 

twij  Icreeg^wucl?  ? 

t wl | c m*n»wl cl ? 3* fwl | cm«n 

t i#j  I C"*n*  »auC  1 ? 3 

«ch*d  noncompete  wlcl?  wucl? 

cnllert  noetet  wlcl?.wucl? 

' cl  3 rHon  * cpteg 

fwl  Ic  I3*wlc  13  1 *twl|cl3 

wuc  13  1 »t  wu  Ic  1 3 

tnllcr«ee»wlc  13  ?*fwllcoee9 

twu  I cp* eg* wuc  13  ? 

t It  I p*X«n*wlc  1 3-  3* f It  Ip+ipn 

ult  I pHcn*  wuc  1 3 3 

ec^ed  noncompete  wlcl3wucl3 
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collect  noe’e*  wlc!3<wuc»3 

1 cM  epee  9 * *#9 
f»«l|cM»wlcM  MmIIcM 

wuc  1 4 1 • tM/lcM 

t lk  I •f»9»wlcl  4 ?*f|tr|t+9 

ulk  I *«9‘WUC 14.? 

twl  |cp»e**wlcl4. 3*(wl |CP*#9 

twu  Icpf  eg*  woe  1 4 3 

tebtd  noncompete  wlcM.wucM 

collect  noetel  hU14.moc14 

! CM*  p»#s  I * »*9 

(wl  I c 1 4**wlc  14.  Mm|  U14f 

MUC 14*  l*twulc 14* 

t 11-  I*eg*wlcl4#.?*(lk|»*9 

ulk  I **g-wuc  14*.? 

t 1 W | pe*g  1 • wl  c 1 4 * 3»(|W|p«eg  l 

u 1 W I P««9  l*Wl»CH*.  3 

tchfd  noncompete  w| c 1 4 • . wuC I 4* 
collect  nottet  w1cl4».wucM« 

1 C 1 4b  p**9  2 4 **9 
(wl  |cl4b*w|c  14b  MwllcHb 
wucHb  1 • twu  I c 1 4b 
t Ik  |«*J*Hlcl4b.2*nMf*? 

U Ik  I fe9*tAJC  I 4b.  2 

tlHPff*  2*uUMb.3*f  lklp»*s  2 

oik  |p»#9  ?*wuc  1 4b.  3 

tched  noncompel*  wlc  14b. wuC  14b 

collect  ooetet  wlc  14b. hoc  Mb 

1 C 1 3#  pHpn  • pf*9  1 

ful Ic 1 3#*wlc 1 3*  l*#wllcl3» 
wuc  13#  I*twulcl3* 

♦ Ik  I pt *9  l*ulc  13#  ?»Hk  I P»*9  1 
u Ik |p«t  9 l »wuc 1 3#  2 
t )k  | phpn*  wlc  13#.  3*  Uk  IpKoo 

U Ik  1rhpn*mjC  I 3*  3 

•ch#d  noncompete  wl C l 3* • wuc I 3* 
collect  ooet#t  wlc  13#. wuc  1 3# 

1 c l 3b  pbon  ♦ rt •#  2 

(wl  Ic  I3b*wlcl3b  l • t wl  Ic  1 3b 

wuc 1 3b  l»twwlc 13b 

t Ik  trees  ?*wlc 1 3b. ?*( Ik Iteef  2 

u 1 k |p*eg  ?*wuc  1 3b  2 

t H | phpn*  wl  c I 3b  3*  Mk  |pN>o 

o Ik  I pt.on*»iuc  1 3b  3 

»rHfd  nnor,p»pete  wlc  1 3b  • I 3b 

collect  ooetet  wlc  1 3b -woe  1 3b 

* clTe  *»o  I ♦ P7#9  1 

(wl  ic l?*» wlc Ic*  !•♦«! Icl?e 

wucl?*  Mtwulcl?* 

tUlr«M  I » wlc  1 ?e  r-MUreei  1 

u H ir*#9  i ir#  ? 

tlk|««o  |*w]cl?a  3* ( I k l*,n  1 
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APPENDIX  C 

Validation  of  Simulation  Results 


Both  the  Bliss/11  and  Hearsay  II  examples  of  Chapter  III  relied  on  the  -esults 
of  statistics  obtained  through  simulations.  When  using  statistics,  one  must  be  prepared 
for  the  possibility  of  error.  For  simulation  experiments,  two  validation  factors  are 
required  to  verify  the  significance  of  the  results  [Gordon  69],  These  are: 

1.  Elimination  of  initial  bias. 

2.  Development  of  a confidence  interval. 

The  method  chosen  for  the  elimination  of  initial  bias  was  the  use  of  trial  runs 
to  detjrmine  simulation  run  times.  Since  many  simulations  were  required  for  the 
Bliss/11  experiments,  a small  number  of  trial  runs  were  used  to  estimate  the  simulation 
run  times  for  all  other  runs.  It  was  observed  that  the  initial  bias  was  eliminated  after 
about  fifty  messages  entered  the  RESULT  process  of  the  Bliss/11  model.  The  number 
of  messages  used  in  the  experiments  ranged  from  475  to  850.  In  contrast  with  the 
Bliss/11  message  number  measure,  the  Hearsay  II  simulations  were  based  on  simulated 
time.  It  was  observed  that  the  Hearsay  II  results  stabilized  after  about  5000  time 
units.  Consequently,  the  amounts  of  time  used  for  the  simulation  experiments  ranged 
from  10,000  to  100,000  time  units.  Thus,  following  one  of  Gordon’s  recommendations 
[Gordon  69],  the  initial  bias  was  eliminated  from  the  experiments. 

The  determination  of  confidence  intervals  for  all  the  simulations  ^vould  have 
required  a relatively  high  overhead  in  the  simulations.  The  standard  techniques 
require  either  repetitions  of  a particular  simulation  using  different  random  number 
generator  seeds  or,  alternatively,  one  very  long  simulation  run  that  is  divided  into  a 
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set  of  batches.  Considering  the  large  number  of  Bliss/11  simulations  that  were 
performed,  It  was  felt  that  the  development  of  a confidence  interval  for  one  simulation 
would  be  used  to  represent  the  entire  set  of  Bliss/11  simulations.  Figure  C-l  shows 
the  data  taken  from  one  Icrig  simulation  run  from  the  Bliss/11  simulation  using  six 
processors  and  FIFO  scheduling. 
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Figure  C-l.  Bliss/11  FIFO  6 Processors  Evaluation  Data 


From  these  data,  907.  confidence  intervals  were  computed  for  the  LEX 
Computing  Time,  [.245,  .264];  Percent  Thru,  [84.6,  88.5];  and  Thru  Rate,  [3.28,  3.57} 
From  the  data  shown  in  Chapter  III,  it  can  be  seen  that  each  of  the  values  falls  within 
these  respective  confidence  intervals  (i.e.,  .259,  88.3,  and  3.28). 

Based  on  the  validation  of  the  numeric  significance  of  this  selected  simulation, 
the  other  Biiss/11  simulations  are  felt  also  to  be  valid.  This  seems  reasonable  since 
the  various  simulation  rasults  did  not  have  any  unusual  patterns. 

The  same  general  techniques  were  used  to  run  the  Hearsay  II  simulations  as 
were  used  for  the  Bliss/11  simulations.  As  discussed  earlier,  the  initial  condition  bias 
was  eliminated  by  runni-  the  Hearsay  II  simulation  for  a tong  time.  Confidence 


intervals  were  not  established  for  the  Hearsay  II  experiment,  because  the  Hearsay  II 
result  was  based  on  an  accumulated  statistic  (i.e.,  average  active  processors)  and  the 
method  used  for  validating  this  type  of  statistic  required  multiple  runs  [Gordon  63], 
Since  each  Hears'  > II  experimental  run  was  relatively  expensive  (from  20  minutes  to  1 
hour  computer  run  time),  this  validation  was  not  felt  to  be  worth  spending  the  required 
resources.  Moreover,  the  Hearsay  II  simulation  results  were  correspondences  to 
Fennell’s  simulation  experiments,  which  were  also  not  validated  [Fennell  75a). 
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